WEEK8 – Thank you and bye bye!

Hello Everyone,

The previous 8 weeks went by both so slow and so fast. On one hand, I don’t even remember when I took my drone license exam, but on the other hand, I feel like my first day of work was just yesterday. I really want to thank Educational Technology department for accepting me for DTSF 2018 and giving me the opportunity to tinker with technology. Thank you Dr. Eric Remy for everything you did for us, we always had the 100% support/help from you. Thank you Kaylynn and Marc for spending time with me and making the workplace more enjoyable. Thank you Renee and for cleaning for us after every single day. Thank you Eric (again), Greg, RC, Chris for the Hamilton Conference. Also, I want to thank everyone, who read my blog post, I really appreciate. At the end, I want to thank the team: Alyssa, Orrin, and Tyler, for co-working with me and spending time together.

Thanks to DTSF, I have learnt a lot about Virtual Reality, the technology which is still growing and has a lot of potential. I really enjoyed working/playing with VR, because I always learn new things about the possibility of VR. I hope VR could work on more platforms with more functionality and portable, so that more people could experience more VR contents.

During my first 3 weeks, I was learning Unity and watching so many tutorials about it. I started making simple mini “games”, where I tested interactions, physics, and movements within VR. I made some simple bowling, baseball, and tennis games. During next 1-2 weeks, I learned about Blender, where I designed my first 3d models, such as a tea cup, table, or assets for my mini “games” (bowling ball, and pins, tennis racket, baseball bat). In Blender, I learned shaping, texturing, UV mapping, and sculpting, which were essential for my project.

My initial project was supposed to be the Virtual Tour of the Gettysburg Battlefield, but due to complications with the National Park Service, I could not take any footage from it. In the end, I worked on the Lincoln Cemetery, which I think was a perfect choice, regarding size, location, accessibility, and historical importance. I did a simple tour of the Lincoln Cemetery, where I 3d modeled the cemetery with Blender, I created the photogrammetry 3d mesh with drone pictures, and I embedded 360 videos. I combined everything together in VR engine, Unity, where I added more interactions with the user.

At the end of this fellowship, I learned so much, I want to learn even more. I can make simple VR content in Unity and 3D model in Blender. Moreover, I can do drone photogrammetry and build 3d models out of it. In addition to what I have learned, I would like to learn making VR content in Unreal Engine, which is a bit more powerful and more options for VR. I hope IT and ET will continue working with VR and allow students to work/play with it more.

Thank you Eric again, I really am happy that I was able to work with you, and be able to learn new skills, which are helpful not only for now, but also for later in life.

Have a good weekend, everyone!

Thank you and bye bye!

Best wishes,

JHA

Week7- Immersive Technology

Hello Everyone,

This week, I attended the Immersive Technology Conference at Hamilton College to learn and share knowledge about immersive technology which included 3D modelling, Virtual Reality, 360 videos, 3D scanning, and photogrammetry. Read more about it: here.

I learned many projects from different students from both Hamilton College and Colgate University. All of these projects were impressive, and I found out that I have still a lot to learn, e.g. the 3D model can be very detailed and can take a lot of time, VR experience can be even more interactive, which together can make the experience even more immersive 😉

My main goal this week was to reconstruct the Spanish theater, EL CORRAL DEL PRÍNCIPE, which existed between 16th an 18th century. Under commands of Chris Oechler (Profe O.), I and Orrin were trying to build 3D model of this theater in Blender and implement it in Unity in order to make the VR experience of the historical theater.

Theater consisted of that stage, two side walls, and the back. Orrin is more efficient in Blender than I am,  so he took the stage and two side walls, and I took the back of the theater. Because the theater consisted of 4 floors, I divided my work into layers (each layer- each floor), so that I could build at least 1 floor each day (4 floors- 4 layers- 4 days).

On the last day, I and Orrin tried to merge two projects together and there was a problem with the roof, because it covered all of the 4 floor, making impossible to see the stage from the 4th floor, so we had rearrange the roof again. At the end, we could finally fix it and we could put the 3D model to Unity and experience it in VR. Right now, the theater is just a grey 3D model, without colors. The next step will be adding the material and texture to the 3D model to make it look more realistic.

Thank you R.C., Profe O., and Eric for the trip and hanging out with us 😀 It was a very unforgettable experience for me. I really enjoyed working and spending time with you guys! Thank you Lord Greg from DHi Hamilton College for hosting us and teaching us important functions in Blender and Unity.

Thank you Profe O. for allowing me to work in your project. Hope that I was not that bad in cooperating.

Thanks Orrin for working with me and helping me. Happy Birthday!!!

Thanks Alyssa for proudly representing our school!

 

Have a good weekend,

JHA

P.S. I still think our school should have some squash court.

Week5 – Getting Closer

Hello Everyone,

Belgium is very close to the final. After eliminating Japan in 1/8 and Brazil in 1/4, Belgium will be facing France in the semi-finals. France and Belgium are the best 2 teams at this time, and it will be a very interesting and close match.

Day1


Alyssa taught me how to do photogrammetry with a drone using Pix4D. I made the 3D model of a stone using different photogrammetry programs to test which one will be the most useful, such as Pix4D, 3DF Zephyr, and Agisoft Photoscan. All of them work quite similarly, that means they start with building a dense point clouds from 2D photos taken earlier from the drone, then create a 3D mesh from a dense cloud, and finally add the texture to the mesh based on the photos.

Photoscan- dense point cloud
3DF Zephyr – 3D mesh
Pix4D – Textured Mesh

Day2


I started building the fences surrounding the cemetery. They look quite realistic. I had to calculate the measurements of the fences in real life and convert it to the measures in Unity. I also looked at positions on the map of every fence in order to place them correctly in my Unity scene. My next step will be building the tombstones.

Day3


4th of July – Independence Day 🇺🇸

Day4


I started to model tombstones in Blender. Luckily, the shape are quite simple, so it was not difficult for me. The only “problem” was that there were many different shapes tombstones. It took me a bit longer, but it was not even an issue. The more I model in Blender, the more I get used to working in Blender. At the end, I made 9 different shapes of tombstones. The next stage is to add the proper material and more realistic feel.

Day5


To make the tombstones more realistic, I added the real rock texture on the tombstones that resemble the same material from the cemetery. Then I shaped the flat faces of the model to be more “rocky” by adding the roughness on the faces using different brushes. I used some free brushes from BlendSwap, where users can share their own brushes with everyone and append it in Blender. Here, I used the brushes from here (shout out to rubberduck!).

Have a good weekend!

JHA

Week4-Half-full, Half-empty

Hello Everyone,

This week Poland “beats” Japan and goes home in a very bad style. It was a very disappointing World Cup for me and Poland. My another favorite team, Germany, … I have no words.

Day1


I worked on creating portals in Unity. This is a set of 2 mirrors which are visualizing the reflection of what another mirror would show. This portals allow the user to go into the mirror-portal and teleport to the place what the mirror is showing. There is an asset called Vive Stereo Rendering Toolkit which is doing the task.

Day2


I was trying to build the models of the bowling of my own and add some spice to it. First, I created the 3D models of a bowling ball and bowling pins in Blender, with no colors added. Then, I used the ZBrush to add some rock roughness to the bowling ball and pins, ZBrush allows to edit the sculpture of the 3D model. Afterwards, I needed to unwrap the 3D model in order to be able to color the specific places of the ball and pins, UV Layout by headus was a perfect program for that job. Finally, to add some material and coloring to the ball and pins, I used Substance Painter. In Substance Painter, I could connect everything above together and add the final touch. Then, Substance Painter will create the maps (normal, height, albedo, metallic smoothness) necessary for Unity to apply all the modifications to the 3D model of a ball and pins.

Notes: I used the free versions of these programs, so don’t hesitate to try them out.

Day3


Data Visualization workshop

Day three was very interesting, because I attended the Data Visualization workshop taught by Sharon. I learned a lot about how the data should be presented in order to make it easily understandable for the reader. Also, I learned that it is not easy to make a proper chart/graph, and there the aesthetics are very important in order to attract the attention of the reader and make it clear for the reader. Moreover, it is very easy to fool our eyes, we only know what we see, presented to us. But it is important to see the bigger picture, which is often difficult (or even intentionally) to present to the reader.

Day4


I tried to fly the drone with the mobile application DJI 4 Go. This application worked well. Basically the app allows to control the drone using the phone, to see what the drone is seeing and to photo or film the moment. I also tried to use Pix4D mobile app, this app could not be used without having another app Ctr+Dji, which connects to the drone and sends the data to Pix4D. However, because I did not have an appropriate phone, the app was available for the phone in the Play Store, so I downloaded somewhere else.

Later that day, I did a very stupid thing and broke the drone propellers, I really don’t want to talk about it, but want to apologize Eric for it. It was so embarrassing and disappointing. I felt so bad. I am so sorry.

Day5


I know that I am behind my initial timeline, but I still have time and with all the skills that I gained during these 4 weeks, now I am able to build what I need for the rest of my project.

Fixed timeline:

Week5

-Starting building the 3D scene in Blender with texturing and import to Unity, creating the scene.

Week6

-Creating a 3D model using drone photogrammetry and importing it to Unity along side with the 3D model.

-Filming 360 static videos of the cemetery and inserting to the Unity scene as the hotspots.

Week7

-Hamilton conference

Week8

-Improving the project and preparing for the final presentation.

Have a good weekend!

JHA

 

Week3 – New, Old Topic

Hello Everyone,

Week3 was not that fortunate as I thought. Poland was going to beat the world at World Cup this year, but unfortunately Poland was beaten by Senegal.

Day 1


Also unfortunately, my initial plans have to be changed a bit, because of a problem that I was supposed to predict. Gettysburg Battlefield belongs to Gettysburg National Military Park, so I am not allowed to fly with a drone above the park and film it. Thus, I got the new topic, which is equally important, or even more, the Lincoln Cemetery in Gettysburg (please, do not confuse with National Cemetery in Gettysburg). Lincoln Cemetery is a cemetery for African American citizens and Civil War soldiers, as even after the Civil War, United States Colored Troops were not allowed to be buried along with white soldiers.

Day2


On a second day I really wanted to build a VR bowling game, because this game would show me how difficult is to build a simple scene and how the objects interact with each other (ball with bowling pins). This was also a good place to play with sound (the ball hitting the pins, the bowling rolling on a lane) and background music. I found a very good tutorial which showed me step by step how to build a bowling game, here (shout out to FuzedVR). After building a bowling game, I realized that 3d modelling will be very important for me, so I started to work on 3D modelling in Blender, an open- source 3D modelling software.

The screenshot of a Bowling “Game” in Unity

Day3


We got new, strong computers, on which me and Orrin will be working. It is vital to have powerful computers which are processing and rendering heavy graphics for Virtual Reality content. Later that day, I was trying to show more of my VR content to Sharon, but unfortunately everything stopped working and crashed working in Unity. I was so sad that I could not show it, I hope that next time I will be able fix it and make it even better, especially for Sharon. In the afternoon, Eric Remy taught us techniques for public speaking and presentation. It was a very valuable lesson, as public speaking is an integral part of our life and it is important to develop it. I will try to build up my confidence and improve my speeches. Thank You, Eric!

Day4


Today, I felt like building more games to get used building environments in Unity. Also, Tyler encouraged me to build a baseball game. The game was quite basic, where the user could grab a bat and hit the incoming balls. Because, the game was so real, it was so difficult to hit the balls. I also tried to build the tennis game, and I used my 3D model of a tennis racket. Tennis game was not that successful as the baseball one. In both of these games, I played with colliders, which are determining the place where the collision happens with different objects that also have colliders.

A screenshot from the Baseball “Game”
The 3D model of a racket

Day5 – testing new things, such as portal, new project


After building these small games, I started to test new things that I can use in Unity. I tried to use portals which can teleport the user to different place. This can be very helpful for my new project, especially if I want to implement 3D modelling, photogrammetry, and 360 videos. The portals can be an interesting way of teleporting to a different, parallel “world.”

Finally, Poland is playing against Colombia this Sunday. Hope they will do better than last time.

JHA