Create original 3D character model and use it with Microsoft HoloLens.
〇Prologue
What do you envision in MixedReality world?
In search of new possibilities in MixedReality world, I created original characters with 3D models and tried how to give life for them.
〇Create original 3D character model
She’s name is Chika Harukaze(春風千花).
She is my digital buddy and my half body at the same time.
This photo was taken in Hokkaido , I am always traveling with Chika.
Combine the latest tools with MixedReality and your 3D character model will be human, not data.
As long as there is love.
〇VRM format
Chika was born as a VRM format.
VRM format is a file format for handling 3D humanoid avatar (3D model) based GLTF.2.0 data for VR applications. It is based on glTF2.0. Anyone is free to use it.
It is a format born in Japan in 2018 has become easier to handle, including commercial use, while inheriting MMD (MikuMikuDance) and other cultures.
And it value the “character identity” that was vague until then.
The creator of the character model can embed the copyright and the usable range in the exported model file.
The creator of the character model can embed the copyright and available range in the exported model file.
If set by the developer, that information in the model can be used to place restrictions within the application to protect the character and its parents.
More information… https://vrm.dev/en/
〇Create Original 3D character
Do you have 3D modeling skills?
Don’t worry! You can make it even if you say no.
"VRoid Studio” is a tool that can easily create VRM models.
VRoid Studio official site ・・・https://vroid.com/en
Install the application and select the type you like.
We can creating original characters by changing the basic character model prepared.
● Face Editor window
Can edit the size and texture of eyes and ears.
The texture tab allows you to change the texture of all parts.
Can export the texture once, edit it with paint software and import it again, or paint directly.
●Hair Editor window
The parts where the most personality of the character appears is the hair.
Selecting procedural hair will create a mesh as a bundle of hair.
Change colors and parameters in the edit tab in the right side window.
Probably many people will not be able to make the hairstyle as expected and will be frustrated.
Here’s an example that makes it easy for anyone to create the hairstyle they want.
- Create Procedural hair and Move by parameter ProceduralParameters/position.
Change the length of hair and the number of bundles.
2.When the rough shape is completed, right-click the procedural hair being edited in the left side window and convert it to handwritten hair.
3.Change the Edit mode to Controll points and move the hair point(drag and drop).
Depending on the hair, switch the edit mode to Select and adjust the offset and fineness of the texture of each hair.
4.Change the hair shape by moving the control point of the guide offset with in edit mode Select.
5.Edit hair color and texture.
6.Select a hair from the bone tab and create a bone.
7.Repeat these steps.
●Body Editor window
Can set your physique in detail.
●Clothing Editor window
Costume can be set.
In VRoid Studio, various expressions are performed on the clothes of the determined type using textures.
This time, will make original clothes easily.
- Export the default image.
2.Open the image exported with “Paint 3D app”(Windows users can use as a standard app.)
3.Insert your favorite image and click “Magic Select”.
3.Perform trimming.
4.Place it where want it on clothes texture, export and re-import in VRoidStudio.
5.The original clothes are completed.
●Camera/Exporter
The original character model has been completed.
Let’s put on a face emotion and move it.
Export
At this time, information such as the author can be included.
Exported in .vrm format.
If you want to edit more finely, you can load it into Blender etc.
You can wear original clothes and accessories that were not possible with VRoid Studio.
The model born here can be seen here.
https://hub.vroid.com/characters/1512169625722584140/models/4955933784727139762
〇DreamShineVRM in HoloLens apps
DreamShineVRM is My first original Apps develop in 2019 Jan.
It was released in the Microsoft store just one year later when I met microsoft HoloLens and start learning C# and Unity etc…
When HoloLens 2 came my hand, I’ll upgrade and introduce new features.
My first step was to load the model at runtime.
This day is December 31, 2017
Announced January 17, 2018
I struggled with blinking and changing facial expressions, making my character look more natural, and working on it for the first time.
See the previous article for some of the stories of me and Microsoft HoloLens.
It is very simple apps
1. Load the character model at runtime
2. Give your favorite expression and pose.
This app can travel with your vrm character.
When you launch the app with HoloLens, your character will be with you. anywhere
Originally made for illustrator and cartoonists.
Users can freely pose their characters, change their expressions, and spend time together in the MixedReality world.
Go to the location and turn on the HoloLens, place the character, attach a facial expression and take a picture.
Anyone can make a manga just by arranging these.
However,
I realized that it was very meaningful for my half body, created with love, to be in the same space at real size.
Chika is not data for me.
I can feel one personality there.
When AI and her merge, and when we can meet at any time in the MixedReality world, she will be one person while still being my half body.
If you look at this article and create your own character with love, that character will surely have a wonderful personality.
They are not data.
The use of MixedReality space will open up more endless possibilities.
Thank you for reading this far.
Have a great time with you and your digital buddy.
