Lip sync stopped working and I've tried everything I can think of. Any help is appreciated.
SUVA - StreamUrVirtualAvatar
A downloadable tool for Windows
- SUVA is mostly for streamers/content creators
- Requires SteamVR + compatible tracking hardware OR a Tobii Eye Tracker (e.g. Tobii Eye Tracker 4C/5)!!!
- Having both is highly recommended as it gives the best tracking of the body in combination with Eye tracking.
- Minor Unity experience required to create/export your avatar
- Avatar creation process similar to VRChat avatar creation process
Note: The avatar shown in the pictures is not included! A white version without Animations is though to get started!
Also please watch the Youtube Tutorials and have a look at the Wiki pages.
- Designed to be used in combination with for example OBS
- Designed to be compatible with most humanoid avatars created for VRChat (same creation workflow)
- Made with Unity 2018.4.20f1 (since SUVA 1.5.6)
- 10 Emoteslots for custom Animations
- Numpad keys 0-9 for triggering of Emotes from anywhere (requires administrator rights!)
- LipSync with optional spatialized realtime playback
- Tracking of the Eyes if Tobii Tracker available (fake Eye movement otherwise)
- Tracking of only the Head and the Eyes if used without SteamVR + hardware but with a Tobii Tracker
- Avatar can be fully calibrated inside the Application
- Settings get saved as avatar profiles in a Json file
Update: SUVA 2.0.0 (no release date yet!)
Update: SUVA 1.5.7 (most recent)
- improved avatar loading reliability by no longer relying on avatar names
- display error messages on loading failure
- fixed microphone selection not working on systems with only one recording device
- added option to select no microphone
- changed that the cursor is no longer locked to the window by default (can still be cycled with 'alt+c')
Update: SUVA 1.5.6
- updated to Unity 2018.4.20f1
- enabled microphone selection (Bug in Unity 2017 is gone now)
- removed network features (some networking features got removed in Unity 2018)
Update: SUVA 1.5.5
- added workaround for mic/audio synchronisation issues
- added more audio related options
- Voice Gain
- Microphone Buffering
- Mic/Lip Resync Interval
- DSP Buffer Size
- improved default audio/lipsync latency
- improved error handling for avatars/visemes
- fixed avatars using the same shapekey for multiple visemes having no facial movement
- updated Unity package for avatar creation (no reexport of avatars required, except if avatar was having viseme issues)
- added automatic uninstallation of previous versions to the Setup file
Update: SUVA 1.5.4
- added laughter viseme support
- added support for avatars with no eye bones
- added support for empty visemes
- updated Unity package for avatar creation (IMPORTANT: avatars need to be reexported for SUVA to be fully functional!!!)
Release Version: SUVA 1.5.3
|Updated||15 days ago|
|Made with||Unity, Blender, GIMP|
|Tags||steamvr, streaming, tobii-eyetracking, Unity, virtual-avatar, vrchat|
|Average session||About a half-hour|
|Inputs||Keyboard, Mouse, Oculus Rift, HTC Vive|
|Links||Discord, Wiki, Homepage, Tutorial Playlist|
In order to download this tool you must purchase it at or above the minimum price of $1 USD. You will get access to the following files:
Log in with itch.io to leave a comment.
Check if it works on the example avatar, if it works with that one it is most likely related to your avatar.
It doesn't work on the example avatar either. My microphone appears and is selected but the viseme readout shows nothing when I speak. This randomly started happening after the windows 10 update.
i dont like asking for free stuff. but i would like to try and see how this works. probably will never need it as im not a streamer.
Awesome tool (:
And it works quite well if you have a setup like me (HTC Trackers + Tobii Eye Tracker).
Only the calibration part is a bit unusual and takes quite a while to get it right...
Anyhow, I did read in other comments that there is a Wiki with some documentation? I couldn't find it, and the only information that I could find was from other users on youtube (with which I could export one of my VRChat avatars in like 5min, so that's nice).
But if there is documentation available, could you maybe place it somewhere that people could find it? That would be nice ;)
There is a section on the main page for it. Also in SUVA there is the About menu option containing the same information. I think I have to show it at the very beginning when you open SUVA. I hid it too well :)
Everytime I try to load the prefab suva file, the avatar doesn't show I just get the default. My friends have tried the same file on their computers and it works on theirs. Is this a bug?
locate the file called AvatarProfiles.json and delete it. Restart SUVA afterwards and try again. Also make sure you are using the latest version and created the avatar with Unity 2018.4.20f1.
Hello, when I try to install the software I get a warning from Norton Anti Virus. Is this normal? I'm on a fresh clean computer.
This can happen because it is unknown Software I guess. If you downloaded it here on itch.io there should be nothing malicious in SUVA.
Yes I did buy and download the software from the itch.io site. It's actually not the Anti Virus but Windows Defender SmartScreen that does it. Otherwise Norton file insight detects it as "less than 50 users in the Norton Community have used this file" and a "Good" rating.
Hi there, I hope you can help me. Upon validating the files I get the following warning:
"Not all Visemes have SHapekeys assigned or not all assigned Shapekeys are available on the selected FaceMeshRenderer [body] for [name of my model]! LipSync may produce no face changed! Please assign valid Shapekey names to the Visemes!"
I export the model and lipsync of course isn't working. I'm not entirely sure what I'm doing or what I skipped or did wrong as I followed the tutorial. How exactly do I fix this? Google has been unable to help with this issue.
It means that one or more default visemes might not exist on the Skinned Mesh Renderer of your avatar. Find the ones that don't exist (in my example it is is called 'example_invalid' and I replace it with one that exists on my avatar: 'Nagomi').
Will 2.0 have potential camera tracking for the head, cause I'd really wanna use my trackers for hands then have my head tracked by a normal camera sorta like how VSeeFace or Luppet does it.
It has been added to 2.0, still working on the facetracking part to control emotes using your own face.
Hello! I am having some problems. I'm following the tutorial on the wiki on how to connect the base station and a vive tracker. The trackers connected, but the base station will not. If you have any other information this, I would appreciate it. Thanks.
Please double check that you followed the guide exactly. To get the base stations to show up make sure they are running (leds are on and they make noise) and wave the paired trackers aroundin front of them. If this doesn't make them show up you can try connecting a tracker directly via usb to the pc and wave the tracker around afterwards again. This can help. As soon as the base stations show up unplug the tracker again. If you still have issues please join the discord server linked here or in SUVA where you can get more information.
I am have a problem with getting my avatar to load. It says "LookAtIK". Where am I suppose to look to fix this?
LookAtIk is a component that I use to control avatar eyes. Maybe your avatar has no eye bones set up. Without them it will not work.
Can I use them without the eyes? This model I made is gonna be tracked with Vive Trackers.
You can use it. Currently an avatar needs to have eye bones assigned though in the import settings in unity. Suva was originally not intended to be used with avatars that do not have eyes. If your avatar does not have eyes you can try assigning an unused bone to both eyes or create empty eyebones in e. g. Blender. Suva has fake eyetracking built in that moves these bones when you don't have a tobii tracker.
Can I only use one tracker for head tracking and thats it?
And any news to possible webcam tracking solutions?
Yes you can use only one, the hand positions can be adjusted with sliders. There is a webcam tracking solution created by the developer of VSeeFace which I will probably integrate into SUVA in the future.
Can this be used directly using vr vive or vr handle?
It can use Vive, Vive controllers and Trackers for tracking. You can't use it to see the avatar in VR.
Is this compatible with the Tobii eye tracker 5? I can't find a 4C available for purchase.
Hi Guribo, we've been working on an app that turns your iPhone into a head pose and eye tracker for PC (amongst other features) and stumbled across some of your users who suggested to get in touch with you directly.
Eyeware Beam is still in beta and we don't have a Unity SDK yet. Is that a must have for you to consider it as an additional input method for SUVA?
Here our beta signup page in case anyone here wants to help us iron out the bugs and prioritize the right features: beam.eyeware.tech
Hi. Having a Unity SDK is certainly desirable. Not just for SUVA but in general. Personally I don't own an iPhone but if there was an SDK and there is demand I'd consider integrating it.
Ok, thanks for the input. I'll get back to you as soon as we have something worthwile to present. The plan is to enable Android devices with 3D sensing capabilities soon after the iOS release as well.
Hey I saw you were working on webcam tracking in December of last year. Just wanted to know if that was implemented yet or if you were still working on it. I'd honestly love to use SUVA but I can't afford the VR stuff or Tobii eye Tracker.
I was testing back then but wasn't happy with either the tools or the conditions attached to them. I might have a working solution soon though.
does it work with valve index?
So i purchased the software, but i don't have the unity package in the folder whatsoever, just the installer and uninstaller. Any fix here?
The unity package is in the install folder. After installing you can either go there or go to the about menu which has a button in it that brings you there.
Do you get updates if you buy the software?
hopefully one day add the tracking with the webcam
Too many problems with it for me to use. No matter the fix I try it can't read my avatar file made for SUVA specifically and the person who made the SUVA file has 0 issues making it load the avatar. Not sure what to do to fix it anymore.
I am sorry to hear that. When someone else makes an avatar for you please make sure you get send the entire folder with the files of the export. When it is still not importing delete the Avatarprofiles.json file that is created when you hit save in Suva. For more information/help contact me on discord please. Either in the Suva support discord or directly. Invitation link is on the store page or in the about section in Suva.
Hello, would this software work with the XBox One Kinect Sensor, since the software is run through SteamVR?
Are there plans to support full body tracking? If so, do you have road map time on when you plan to implement it?
im not sure why but i tried using this while streaming and playing games and it gives me frame drops i looked at cpu ram gpu nothing it cant handle my pc wont even lag if i have vrchat open while playing games and streaming so i dont know what to do coz it makes everything unplayable.
What is your setup? Multimonitor? Tobii Eyetracker? Vive/Index/Rift? CPU/GPU? Have you tried other avatars? Have you tried lowering the quality settings (hold shift or alt while suva starts)? Feel free to join the support discord (linked on the product page or in the about section in suva).
So far, I'm absolutely happy to see how awesome this is. :D Can't wait to use it in a stream or two. Excited for how 2.0 looks (and the laughter fix >3>)
I want to use it, but my setup is a bit weird at the moment and it seems to be incredibly broken/ or very hard and unintuitive to setup with an oculus CV1 and an xbox one kinect.
I will love to use this with webcam, if it was supported i happily pay triple and refer all my clients to buy, setting up Facerig is a nightmare, this look so easy to setup
I just want to say this is by far the best Vtuber/Vstreamer software there is and I love it. And just what's planned for the 2.0 release has gotten me excited for it. Not asking for a release date or anything like that. I'm just saying I really appreciate what you've created.