Discuss technology related to vtubing. This could be talking about existing programs and apps for vtubing, or exciting new tech on the horizon.
Full body tracking VSeeFace and VR Chat with Xbox 360 Kinect in 2023
Hello,
I'm thinking about getting Xbox 360 kinect for full body tracking in VSeeFace or VR Chat.
Can someone tell me how to manage it or rather is it still working method in 2023?
Also is some additional cables/adapters are needed please list them.
I think that your only way is to use VirtualMotionCapture which it's based on VR headset and vr tracking devices, I think you can use VMC protocol and maybe combine it with a camera in VseeFace, Only with the pay/supporter version you will be able to try and test that sadly.
https://akira.fanbox.cc/
https://www.patreon.com/sh_akira
Looks... difficult.
I found some 2 years old methods for Kinect here: https://www.reddit.com/r/vtubertech/comments/pvbkwr/configuring_360kinectgum_and_vseeface/
but Im not sure is it still working.
Difficult to say really
I used kinect motion capture for a university project but it was about 6 years ago I'm afraid, 1 kinect was fine 2 was better, a special adapter was used, I believe its simply a kinect PC adapter and overall it was quite a pain to get it working, especially space wise as it needed alot of room to get a good capture, when it did its tracking was good, not great but good for the purposes I needed it for on a really tight budget. It would however throw alot of problems my way when getting the capture data and would freeze often. In my experience it was a fun thing to do but it was a real pain in the butt, your experience may vary, as an alternative there are some truly progressive webcam tracking options these days which honestly would give similar results to what I've seen so I would look at those and see if it works with what you've already got and is fit for purpose, good luck.
As from my personal research you are better off with some other means of body tracking, because the kinect's hardware is rather dated at this point and there isn't many applications you could use it with (or you would need to write your own program for it)
At least that was the conclusion I cam to when I was researching it last year
Can you provide any other not expensive methods for full body tracking in VSeeFace(or other program that support .VRM files) and VRchat?
Tracking no need to be accurate as nowadays methods btw.
For now kinect(as a device) looks like a cheapest way that's why i asked about it.
Old video covering options (there are obviously way more options out there since and with some googling you can find a lot of options too):
https://www.youtube.com/watch?v=jUgQYwGx7cY
No VR gear tracking:
https://www.youtube.com/watch?v=feIYEb1K4Po
HTC Vive tracking:
https://www.youtube.com/watch?v=CgUvvV9kC3M
VSeeFace + VMC:
https://youtu.be/LkO0VusjkHU
Also for future reference (as it is only fully avaliable in Japan yet) Mocopi by Sony may be a good full body tracking option (not exactly cheap, but if you are not in a hurry may worth to save up for it when it releases in the west)
kinect is terrible and outdated by now, like nobody in VR even wants to use that method anymore due to how janky it is. kinect was even laughed out of the market by regular gamers because of how bad the accuracy is.
if you want budget and actual accuracy, then just buy SlimeVR (and wait to end of year because they're crowdfunded and currently assembling first batch) or use their DIY guides to buy some pcbs and learn how to solder your own SlimeVR trackers, because it'll be cheaper than buying tundra tracker or haritorax or vive pucks
SlimeVR's software already supports VMC that'll pipe straight into VSeeFace/other vtubing apps, and also has OSC for VRchat. Their discord is here and has some help channels for the DIY: https://discord.gg/YRYYW3UC
that's like srsly the only good crowdfunded tracker right now, other than if you consider AprilTag if you want to go even jankier: https://github.com/ju1ce/April-Tag-VR-FullBody-Tracker
in terms of jankiness:
jankiest is kinect
less janky is AprilTag
even less janky and comparable to regular fbt is SlimeVR with cm accuracy if you don't care about mm accuracy + requires 0 basestations + you can cover yourself in blankets with it on UNLIKE vive pucks which rely on basestations.
regular fbt solutions are vive pucks, tundra trackers, more expensive full suit with bands
There are probably some Tutorials on YouTube? But just as a heads up, it's not going to be the most accurate tracking. Most image based tracking is really weird and (in my experience) that tracking specifically has a difficult time tracking legs and feet especially if you plan on walking around much. Good luck and let me know how it goes!