SUVA - StreamUrVirtualAvatar
A downloadable tool for Windows
IMPORTANT:
- SUVA is mostly for streamers/content creators
- Requires SteamVR + compatible tracking hardware OR a Tobii Eye Tracker (e.g. Tobii Eye Tracker 4C/5)!!!
- Having both is highly recommended as it gives the best tracking of the body in combination with Eye tracking.
- Minor Unity experience required to create/export your avatar
- Avatar creation process similar to VRChat avatar creation process
Note: The avatar shown in the pictures is not included! A white version without Animations is though to get started!
Also please watch the Youtube Tutorials and have a look at the Wiki pages.
Features:
- Designed to be used in combination with for example OBS
- Designed to be compatible with most humanoid avatars created for VRChat (same creation workflow)
- Made with Unity 2019.4.29f1 (since SUVA 1.5.9)
- 10 Emoteslots for custom Animations
- Numpad keys 0-9 for triggering of Emotes from anywhere (requires administrator rights!)
- LipSync with optional spatialized realtime playback
- Tracking of the Eyes if Tobii Tracker available (fake Eye movement otherwise)
- Tracking of only the Head and the Eyes if used without SteamVR + hardware but with a Tobii Tracker
- Avatar can be fully calibrated inside the Application
- Settings get saved as avatar profiles in a Json file
SUVA 2.0.0
- Unless I lose my job or win in a lottery there will be no further development towards release 2.0. By the time it would be ready for release it would be hopelessly outdated and everything would have been a waste of precious lifetime.
Update: SUVA 1.5.9 (September 10, 2021)
- updated to Unity 2019
- tweaked avatar loading/saving
- added quality selection menu to performance menu
- tweaked quality presets
- re-introduced 8x AA in Ultra preset
- disabled VSync in all presets
Update: SUVA 1.5.8
- fixed issues with Tobii Tracker 5
- replaced framerate limiter for better performance
- added autofilling of visemes to the avatar descriptor
Update: SUVA 1.5.7
- improved avatar loading reliability by no longer relying on avatar names
- display error messages on loading failure
- fixed microphone selection not working on systems with only one recording device
- added option to select no microphone
- changed that the cursor is no longer locked to the window by default (can still be cycled with 'alt+c')
Update: SUVA 1.5.6
- updated to Unity 2018.4.20f1
- enabled microphone selection (Bug in Unity 2017 is gone now)
- removed network features (some networking features got removed in Unity 2018)
Update: SUVA 1.5.5
- added workaround for mic/audio synchronisation issues
- added more audio related options
- Voice Gain
- Microphone Buffering
- Mic/Lip Resync Interval
- DSP Buffer Size
- improved default audio/lipsync latency
- improved error handling for avatars/visemes
- fixed avatars using the same shapekey for multiple visemes having no facial movement
- updated Unity package for avatar creation (no reexport of avatars required, except if avatar was having viseme issues)
- added automatic uninstallation of previous versions to the Setup file
Update: SUVA 1.5.4
- added laughter viseme support
- added support for avatars with no eye bones
- added support for empty visemes
- updated Unity package for avatar creation (IMPORTANT: avatars need to be reexported for SUVA to be fully functional!!!)
Release Version: SUVA 1.5.3
Download
Click download now to get access to the following files:
Development log
- Hotfix - SUVA 1.5.9 (eye look direction)Oct 06, 2021
- Version update - SUVA 1.5.9 (Unity 2019 update)Sep 10, 2021
- Version update - SUVA 1.5.8May 24, 2021
- Version update - SUVA 1.5.6Jun 11, 2020
- SteamVR Tracker issue workaroundNov 08, 2019
- Strawpoll Tobii Eye TrackerMay 22, 2019
- Version update - SUVA 1.5.5May 18, 2019
- Version update - SUVA 1.5.4May 14, 2019
Comments
Log in with itch.io to leave a comment.
no Unity 2022 verison OvO I still using
Avatars should still work with 2019 unless you use shaders that rely on 2019+.
Updating this old/outdated version won't improve anything but most likely cause new problems.
man if this had face tracking or vmc protocol it would of been a great app, seen people still using it since is easier than other apps to use
Hey Guribo! so I tried opening the app but it says I don't have accuse to it. I don't know how to fix the problem :(
(I also deleted it by mistake UnU)
accuse? Not sure I understand
believe they meant they dont have access to the app, though the rest of their comment is still a tad vague
I really need to study I missed spelled the word ;-;"
hey it's ok dude!
And oh btw I am a she I just didn't change my profile yet 🙄
IT KEEPS FREAKING SAYING IT COTAIN A VIRUS HOW IN THE HECK AM I SUPPOSED TO WORK THIS X-X
ehhh- I missed spelled--
They have any new update ? or you already stop ? OWO
no more support anymore, so its pretty much stuck as it is, sad the person that made it didnt make it open source when they quit it seems, so nobody can pick it up even if they would want to
Yup Too Bad ... because this is most easy software to use , dont need any VRM , just right click . If can i will like to pay it and upgrade more emote or something else .. so sad QUQ
Yep no more support X-X
Hey there Guribo! First I wanna say thank you for making this program. It has helped me a lot with my VTubing and VirtualStreaming. This program that you've created have changed my life. But I've been having issues starting up SUVA for the past couple days ever since I updated it from 1.5.6 to 1.5.9. I'm wondering if it's a common issue at the moment or if its only me. Every time I try starting it, I get this small window for a split second and the program closes itself. I noticed that on it also displayed a red exclamation mark. Is there a way to fix this or is it going to be fixed on the next update?
Hi, you can try deleting the directory where you installed it. It looks like there is some files that still belong to 1.5.6 which confuse 1.5.9. After deleting the directory install the latest version again. If this doesn't fix it you can try deleting the saved profiles and avatars. The latest version uses Unity 2019 avatars and loading an older avatar may crash SUVA.
Okay so I deleted all profiles and avatars that had any connection with SUVA. I uninstalled SUVA, reinstalled 1.5.9. But the program still has the issue. Also btw, it'd be better if I can somehow directly contact you instead of us chatting here. If you're fine with it of course.
The link to the Discord is on the main page. Uninstalling alone is sadly not enough. You need to delete the entire content of the directory where you installed it before reinstalling.
a number of questions since it's been super hard finding youtube videos about these buuuuut
1 does it do leap motion? never touched vr before so i don't have any equipment.
how would mouth and eye tracking work because i really don't want to rely on hotkeys and would rather be able to make mouth and eye motions naturally. I've seen theres the tobii eye tracker, but i'm going to assume that doesn't do mouth. I've also seen the vive facial tracker but, again, not sure if that's supported or anything.
Hi, currently there is only eye tracking based on Tobii Tracking and lipsync based on voice input. Gestures, facial expressions etc. are triggered using keyboard shortcuts but need to come with the model in form of animations.
Support for face tracking based on your actual face is not yet available.
Leap motions support is one of the features I am working on currently.
I suggest you try for example VSeeFace instead as it fits you better. It comes with webcam tracking and leap motion support.
Thanks for letting me know. I am working on getting the 2019 version released this weekend which will hopefully fix this as well. If it still happens after the update please let me know again.
Will do. Thank you for all your hard work on this program.
I know is a bit long time , but can you update 2019 unity version? i really like your work
Thank you! I will release it soon when everything works again. A few things stopped working after the update.
Thank you very much , already use SUVA 2 year (Love you UWU)
Quite a dumb question, but can SUVA use the Xbox Connect to track?
It is not supported directly. In case there is tools that make it show up as steamvr tracker then these virtual trackers can be used in suva.
Thank you very much, I appreciate it.
Can i make rushia??
I don't know what that means.
Hi Guribo, getting back to you with an update and question.
Eyeware Beam, our iOS app for head and eye tracking, is now in public beta, temporarily free. You can download it from the App Store : https://beam.eyeware.tech/.
We progressed with our Unity SDK, and were wondering: what data do you use from the Tobii eye tracker? For generating eye movements, do you use the 2D gaze point on the screen, or do you have access to a 3D ray coming from the eyes ?
I saw some comments that out-of-screen gaze makes the eyes blink, it sounds like you are then only using 2d screen gaze. If yes, would you like a 3D gaze ray that doesn’t have that issue?
Hi. I use 2D gazepoints. I don't have phone support in SUVA and it is also not planned any time soon. SUVA is still in the process of opening up the possibility to easily add new tracking systems so that in the future I can support new tracking technologies without much work. So right now I am not yet interested.
Despite that I appreciate the offer very much! Thank you!
Do I need to use Vive Trackers to track my hands, or are there any other possibilities?
As long as it is a SteamVR compatible tracker anything can be used for hand position tracking.
I love this tool and its really helpful!
But lately and quite suddenly SUVA does not want to recognize any microphone audio regardless of what my default microphone is. I don't know how to fix this.
Thanks for letting me know!
![]()
![]()
You can try deleting your AvatarProfiles.json file (make a backup first though). Maybe something in your saved profile is causing it. You can find it via a button in the avatar settings. Afterwards restart SUVA.
Also make sure that your start SteamVR first before you start SUVA, it likes to change your audio devices to the VR HMD (in case you use SteamVR tracking).
Hi.
Could you please try to add support for the:
Pimax eye tracking module (developed by 7invensun)
https://pimax.com/product/eye-tracking-module/
Pimax hand tracking module (developed by Ultraleap)
https://pimax.com/product/hand-tracking-module/
By the way, the Pimax HMDs are SteamVR compatible.
If you need access to the hardware I can probably arrange something, as long as you return it.
Hi. I am sorry but SUVA is not really a vr application. Eye tracking in a vr headset simply does not work with the current implementations in SUVA or would look super weird as the player is not facing the screen. Not many people have a pimax and even less have one with eyetracker... so I am sorry but i don't see myself adding support for it.
Alright, I understand. No worries, cheers!
Hi there! For starters I wanted to say I love SUVA and I'm glad to see further development of it. ❤
I just wanted to ask about the Tobii eye tracking as there are some changes that seem to be a step forward but with some caveats. It looks like the intention in the new version is to have the virtual monitor track with head movement somewhat but now I'm having my eyes get stuck as I tend to look off the main screen over at a second monitor frequently to read messages. When I look back at the main tracked monitor, my eyes are locked to one side. I seem to have to over extend my head in the opposite direction to re-centre my eyes again.
I was wondering if there would be a way to set a threshold perhaps to reset the virtual display position relative to the current head orientation or maybe put something like a dynamic bone on the virtual screen object to have it smoothly transition back to the current head location?
Of course I'm not a dev or anything so please correct me if I'm missing something or interpreting this incorrectly.
I took a quick video to illustrate the problem I'm having all be it with exaggerated head movements.
Thanks for letting me know. The eyes will close when looking at a second monitor. That is a limitation by Tobii tracking and the way I interpret blinking from it.
What should not happen however is that the eyes get stuck. I will look into that.
Besides that I noticed that your avatars eyes are very twitchy. You may want to increase the virtual monitor distance and adjust the limits a bit.
Thanks for looking into that. I'm aware the tobii tracker only can do one monitor unfortunately but yeah the eyes getting stuck is a bit annoying.
As for the twitchy eyes, I tend to distance the monitor like you suggested but left it on default settings just to illustrate the issue.
Thanks again!
So I just wanted to revisit this since I had to upgrade to the 2019 unity version which still has this issue.
I noticed that it looks like the virtual screen position is relative to the chest/spine direction which can sometimes lag behind the position of the head due to the way the IK is implemented.
Is it perhaps possible to position the virtual screen relative to the head direction instead?
Eyetracking is implement to always look at the camera, it is not relative to the head or chest. You can test this by looking at the center of the SUVA window and rotating the camera left and right, you will see that the avatar keeps looking at you until it hits its range limit. In SUVA 2.0 this entire system gets updated and you will be able to choose what is being looked at. SUVA 1.X will not receive any feature updates but only bug fixes when needed. This is not a bug though, this was by design.
Recently I'd done some work on my avatars to change their expressions, and now all the avatars I load in are lit up extremely bright. I've tried deleting the directional light in Unity before exporting, and then removing all light sources in the scene, but they still look overbloomed. I do apologize if this is my lack of skill with Unity lighting, but if it's from the program will there be a fix or a feature update to allow lighting changes within SUVA?
Edit: I don't want just this to be what people see of SUVA, people must know that I use this program nearly daily for streaming or discord calls, etc, and I absolutely love and admire the work that's been put into this!! I cannot praise this software engineer enough 💜
Something like that is planned for SUVA 2.0. I haven't changed the light setup in the recent update. As long as your avatar has no additional light sources it should look fine. I will also check again to make sure that I didn't mess this up ;)
Heyo! I was wondering if you plan on making Suva work with Arkit/facial tracking in the future?
Good Day! My avatar out of the blue stopped tracking with the Tobii Eye Tracker 5. Both Suva and Tobii work correctly separately, but I can no longer get my avatar to move, even with Tobii selected as the head tracker. I have tried everything I could think of to fix the issue but nothing is working. Any solutions?
You can try open the avatar cache directory and delete the json directory inside it. This will delete your avatar profiles though.
where can i find the avatar cache directory. i have the same issue. my avatar worked fine for like 3 hours and then later on it decided not to with the Tobii eye tracker 5.
In the avatar menu, it is next to the import button. It opens your explorer at the location where all your imported avatars and settings are stored.
Experiencing this issue as well, deleting avatar cache did not seem to fix it :c
The issue is related to the plugin being out of date. I will update SUVA later today. That should fix tracking with tobii tracker 5.
Do Webcams work with this program?
Only SteamVR and Tobii Tracking is supported.
Been working on a model for someone and every time I try to pull up an avatar I get the error code:
"Loading Failed: Object References not set to an instance of the object."
If correct dynamic bones work with this app? With the avatar that doesnt have dynamic bones I dont get this error, just with it... Kind of odd.
Dynamic bones are supported. Check that you use the supported unity version 2018. 4.20f1. Check that the dynamic bone component has a root bone assigned.
I would like to see a way to change or redefine emote hotkeys, besides numpad.
Cause i kinda use the numpad on certain games n was planning to buy like marco numpad of some sort (like the Razer one) to assign the emotes on there, so it be seperate away from my acutal keypad.
Is on my list and planned.
Lip sync stopped working and I've tried everything I can think of. Any help is appreciated.
Check if it works on the example avatar, if it works with that one it is most likely related to your avatar.
It doesn't work on the example avatar either. My microphone appears and is selected but the viseme readout shows nothing when I speak. This randomly started happening after the windows 10 update.
I just fixed it by using the uninstaller and reinstalling it. Idk what happened to break it.
Awesome tool (:
And it works quite well if you have a setup like me (HTC Trackers + Tobii Eye Tracker).
Only the calibration part is a bit unusual and takes quite a while to get it right...
Anyhow, I did read in other comments that there is a Wiki with some documentation? I couldn't find it, and the only information that I could find was from other users on youtube (with which I could export one of my VRChat avatars in like 5min, so that's nice).
But if there is documentation available, could you maybe place it somewhere that people could find it? That would be nice ;)
Cheers!
There is a section on the main page for it. Also in SUVA there is the About menu option containing the same information. I think I have to show it at the very beginning when you open SUVA. I hid it too well :)
Oh... yeah, that's quite well hidden >.<
Everytime I try to load the prefab suva file, the avatar doesn't show I just get the default. My friends have tried the same file on their computers and it works on theirs. Is this a bug?
locate the file called AvatarProfiles.json and delete it. Restart SUVA afterwards and try again. Also make sure you are using the latest version and created the avatar with Unity 2018.4.20f1.
I did it!!! Tysm!!!!
You are welcome. This bug occurs sometimes and will be fixed in future updates.
Having the same issue. Tried deleting the file and have uninstalled and reinstalled multiple times on different computers with no luck.
Hello, when I try to install the software I get a warning from Norton Anti Virus. Is this normal? I'm on a fresh clean computer.
This can happen because it is unknown Software I guess. If you downloaded it here on itch.io there should be nothing malicious in SUVA.
Yes I did buy and download the software from the itch.io site. It's actually not the Anti Virus but Windows Defender SmartScreen that does it. Otherwise Norton file insight detects it as "less than 50 users in the Norton Community have used this file" and a "Good" rating.
Thank you for this information. To my knowledge it is safe to use SUVA. If this turns out to not be the case at some point I am going to alert everyone.
Hi there, I hope you can help me. Upon validating the files I get the following warning:
"Not all Visemes have SHapekeys assigned or not all assigned Shapekeys are available on the selected FaceMeshRenderer [body] for [name of my model]! LipSync may produce no face changed! Please assign valid Shapekey names to the Visemes!"
I export the model and lipsync of course isn't working. I'm not entirely sure what I'm doing or what I skipped or did wrong as I followed the tutorial. How exactly do I fix this? Google has been unable to help with this issue.
It means that one or more default visemes might not exist on the Skinned Mesh Renderer of your avatar. Find the ones that don't exist (in my example it is is called 'example_invalid' and I replace it with one that exists on my avatar: 'Nagomi').
I got it! Thank you!
Will 2.0 have potential camera tracking for the head, cause I'd really wanna use my trackers for hands then have my head tracked by a normal camera sorta like how VSeeFace or Luppet does it.
It has been added to 2.0, still working on the facetracking part to control emotes using your own face.
That's awesome to hear, looking forward to using it. If you ever need people to test it out I'm always happy to put it through a rigorous test.
Hello! I am having some problems. I'm following the tutorial on the wiki on how to connect the base station and a vive tracker. The trackers connected, but the base station will not. If you have any other information this, I would appreciate it. Thanks.
Please double check that you followed the guide exactly. To get the base stations to show up make sure they are running (leds are on and they make noise) and wave the paired trackers aroundin front of them. If this doesn't make them show up you can try connecting a tracker directly via usb to the pc and wave the tracker around afterwards again. This can help. As soon as the base stations show up unplug the tracker again. If you still have issues please join the discord server linked here or in SUVA where you can get more information.
I am have a problem with getting my avatar to load. It says "LookAtIK". Where am I suppose to look to fix this?
LookAtIk is a component that I use to control avatar eyes. Maybe your avatar has no eye bones set up. Without them it will not work.
Can I use them without the eyes? This model I made is gonna be tracked with Vive Trackers.
You can use it. Currently an avatar needs to have eye bones assigned though in the import settings in unity. Suva was originally not intended to be used with avatars that do not have eyes. If your avatar does not have eyes you can try assigning an unused bone to both eyes or create empty eyebones in e. g. Blender. Suva has fake eyetracking built in that moves these bones when you don't have a tobii tracker.
Can I only use one tracker for head tracking and thats it?
And any news to possible webcam tracking solutions?
Yes you can use only one, the hand positions can be adjusted with sliders. There is a webcam tracking solution created by the developer of VSeeFace which I will probably integrate into SUVA in the future.
Can this be used directly using vr vive or vr handle?
It can use Vive, Vive controllers and Trackers for tracking. You can't use it to see the avatar in VR.
Is this compatible with the Tobii eye tracker 5? I can't find a 4C available for purchase.
It is.
Hi Guribo, we've been working on an app that turns your iPhone into a head pose and eye tracker for PC (amongst other features) and stumbled across some of your users who suggested to get in touch with you directly.
Eyeware Beam is still in beta and we don't have a Unity SDK yet. Is that a must have for you to consider it as an additional input method for SUVA?
Here our beta signup page in case anyone here wants to help us iron out the bugs and prioritize the right features: beam.eyeware.tech
Hi. Having a Unity SDK is certainly desirable. Not just for SUVA but in general. Personally I don't own an iPhone but if there was an SDK and there is demand I'd consider integrating it.
Ok, thanks for the input. I'll get back to you as soon as we have something worthwile to present. The plan is to enable Android devices with 3D sensing capabilities soon after the iOS release as well.
Hey I saw you were working on webcam tracking in December of last year. Just wanted to know if that was implemented yet or if you were still working on it. I'd honestly love to use SUVA but I can't afford the VR stuff or Tobii eye Tracker.
I was testing back then but wasn't happy with either the tools or the conditions attached to them. I might have a working solution soon though.
I will be sure to keep an eye out then. I tried other programs but the VRM requirement messes with my models.
does it work with valve index?
yes
So i purchased the software, but i don't have the unity package in the folder whatsoever, just the installer and uninstaller. Any fix here?
The unity package is in the install folder. After installing you can either go there or go to the about menu which has a button in it that brings you there.
Do you get updates if you buy the software?
Yes