Final Week and Presentation!

Week 7


At this point my quest to create a fully autonomous insulin pump from scratch was coming to a conclusion (at least for what I wanted to do in the short 8 weeks that I had to work, I will continue to improve designs and make the pump better in the future). I was making iteration after iteration of prototypes with small tweaks to each one to see which one I could get to work the way that I wanted. This week I called the “grind week” because there wasn’t much learning compared to previous weeks, but it was time to buckle down and get a working piece of technology.

 

The Final Design


The design you see above is the case that I created in tinkerCad to work with the rack and pinion gear system that I have mentioned in previous blog posts. Most of the additions to this design address the rigidity of it. I know that the filament I was using (PLA) isn’t the most appropriate for making strong object, so a lot of the strength in the pump had to come from the design of the case itself. I also add a collar to the reservoir holder (the part in the center of the photo that looks like a hollowed out cylinder) because it allowed me to get very consistent flow from the pump, and makes reloading the pump with insulin much easier. I also add a few cutouts for ventilation to keep the hardware from over heating, and that is the extent of the design that I went with. Each iteration I calculated to cost less than ten cents. At this point both the software and hardware were integrated together and I had a working, consistent insulin pump that worked in a true feedback loop. I was happy with the way that the pump was working and was able to get it to pull data continuously for hours and use it to pump insulin (the only reason I stopped was because I had to go to bed and didn’t want the pump to run over night without me watching it). I am confident that this feedback loop could work continuously for the life of the set and CGM.

Presentation Week


With my project being at a satisfactory spot for the presentation that was fast approaching, it was time to shift gears from building things, to being able to communicate some of the things that I was able to accomplish over the past 8 weeks. I believe that my biggest accomplishment in this project was the fact that I was able to create a truly closed-loop system that was more than $9,200 cheaper than the hybrid systems that companies have put out recently. I believe that there is a long way to go in the race to create a mechanical pancreas, but there’s no time to stop. I will keep up to date on any further improvements that I make!

I would like to thank Dr. Remy along with the entire educational technology team for the opportunity to build something that I have dreamed about for years. Thank you to everyone else who has supported me in the quest to build this. It was truly an amazing experience and one that I will never forget. The fight against diabetes isn’t over, but the future is promising and I look forward to any improvements that I may be able to make in the future.

You can watch my presentation here

 

WEEK8 – Thank you and bye bye!

Hello Everyone,

The previous 8 weeks went by both so slow and so fast. On one hand, I don’t even remember when I took my drone license exam, but on the other hand, I feel like my first day of work was just yesterday. I really want to thank Educational Technology department for accepting me for DTSF 2018 and giving me the opportunity to tinker with technology. Thank you Dr. Eric Remy for everything you did for us, we always had the 100% support/help from you. Thank you Kaylynn and Marc for spending time with me and making the workplace more enjoyable. Thank you Renee and for cleaning for us after every single day. Thank you Eric (again), Greg, RC, Chris for the Hamilton Conference. Also, I want to thank everyone, who read my blog post, I really appreciate. At the end, I want to thank the team: Alyssa, Orrin, and Tyler, for co-working with me and spending time together.

Thanks to DTSF, I have learnt a lot about Virtual Reality, the technology which is still growing and has a lot of potential. I really enjoyed working/playing with VR, because I always learn new things about the possibility of VR. I hope VR could work on more platforms with more functionality and portable, so that more people could experience more VR contents.

During my first 3 weeks, I was learning Unity and watching so many tutorials about it. I started making simple mini “games”, where I tested interactions, physics, and movements within VR. I made some simple bowling, baseball, and tennis games. During next 1-2 weeks, I learned about Blender, where I designed my first 3d models, such as a tea cup, table, or assets for my mini “games” (bowling ball, and pins, tennis racket, baseball bat). In Blender, I learned shaping, texturing, UV mapping, and sculpting, which were essential for my project.

My initial project was supposed to be the Virtual Tour of the Gettysburg Battlefield, but due to complications with the National Park Service, I could not take any footage from it. In the end, I worked on the Lincoln Cemetery, which I think was a perfect choice, regarding size, location, accessibility, and historical importance. I did a simple tour of the Lincoln Cemetery, where I 3d modeled the cemetery with Blender, I created the photogrammetry 3d mesh with drone pictures, and I embedded 360 videos. I combined everything together in VR engine, Unity, where I added more interactions with the user.

At the end of this fellowship, I learned so much, I want to learn even more. I can make simple VR content in Unity and 3D model in Blender. Moreover, I can do drone photogrammetry and build 3d models out of it. In addition to what I have learned, I would like to learn making VR content in Unreal Engine, which is a bit more powerful and more options for VR. I hope IT and ET will continue working with VR and allow students to work/play with it more.

Thank you Eric again, I really am happy that I was able to work with you, and be able to learn new skills, which are helpful not only for now, but also for later in life.

Have a good weekend, everyone!

Thank you and bye bye!

Best wishes,

JHA

Week 8 Update and Final Overview

It makes me sad to think that this will be my last blog post of the Summer with DTSF. This whole experience was amazing for me and I learned a lot about VR and self learning. I hope to take both of these skills and apply them in the future. There is a lot of potential with Blender and Unity. It was very fulfilling to help recreate the 17th century Spanish theater and I would love to pursue more projects like that one. I also got to learn a lot about the college history during the civil war and it was fun virtually restoring the past iterations of Penn Hall. I am pretty confident that I can create anything in Blender at this point. The only problem is being able to create an item with a low enough polygon count that doesn’t crash the computer.

Outside of VR, DTSF was able to immerse me in a whole plethora of new technology that I didn’t even know existed before this internship. Stuff like 3D printing, Arduino, Raspberry Pi, and photogrammetry all seem very fun to learn and I am open to looking into them for future self-guided projects during the semester.

Overall I wasnt able to accomplish my original task this summer but that doesn’t mean this summer was a waste. It was quite the opposite in fact. When I first arrived in week 1 I was looking for the best way to persue my project. I was split between photogrammetry and 3D modeling. Both are compatible with Unity and VR and photogrammetry is much faster in making models so it was very hard to not go with photogrammetry. With a drone I would most likely be able to put together a model of the entire campus within a week or so and spend the rest of time adding cool VR interactions. Going this route would allow for a lot more time in Unity as well.

After the second week, there were three reasons why I decided to go with the more tedious route and why you should too. The first reason was the distortions close up. Photogrammetry models always looked good from a distance but up close they usually became blurry and distorted where the photographs were lacking. This would be especially visible in VR when the user is at a ground level height looking up at a model that is filled with blurry colors and distortions. While this may be useful in some kind of background setting, it would look very sloppy to use these models in your main scene. The second reason was the 2017 DTSF class already had 2 photogrammetry developers. Part of the program is to be useful to the college as a resource if needed, and my project would have been very similar to Ryan Gonzalez if I went the photogrammetry route, especially because he already modeled most of the large areas of campus. The final reason was the skill set I wanted to develop. Coming out of the summer I wanted to have the ability to create any virtual space I can dream of, something that is not possible with models based on things you take photos of.

While there were a lot of good reasons to go with 3D modeling, there were also setbacks that made me hesitant. I knew the 3D modeling route would be much slower and harder to learn. I basically had to go through a couple weeks of art school to get some of the necessary artistic abilities required for the 3D modeling platform. Also the modeling process is worlds slower than photogrammetry. In 3D modeling one has to model a virtual building with their bare hands. While this may seem simple at first, the more time you spend on the building the more details you realize have to get added, and it becomes a never ending cycle until you realize there is an infinite amount of detail one can add while modeling. Due to these setbacks, I decided to focus on Penn Hall; the cornerstone of Gettysburg College. Since Penn Hall use to be the only building at the college when it was founded I am technically still fulfilling my project of modeling all of campus (hehe).

My newer modified version of the project was now going to be focusing on making Penn Hall as visually accurate as possible as well as creating past models of the building to give a perspective on what Penn hall use to look like over a century ago in VR. While this may seem like a huge downsizing of my project, it was the right way to go. Little did I know my decision would heavily pay off when we went to go to the Hamilton conference. I showed up there with a lot of confidence and I also met several students and mentors who are also using the Blender and Unity combo. This was very reassuring and made me feel like I wasn’t learning a useless skill. Greg was the leader of the conference and had been using Blender for 15 years. He taught me a lot and was very helpful with our project. Even though we didn’t finish the theater, we got a lot more done than expected and it was a lot of fun to make. I hope that I will be able to continue reconstruction of the theater when the semester starts.

The last week was just two days. One was spent practicing our presentations and the other was spent presenting. Overall I felt like all of the presentations went really well. The crowd seemed very engaged in each of our talks and I got a lot of good experience with public speaking as I’m sure the rest of the DTSF team did. This was a great opportunity for me and it inspired me to try some exiting projects of my own during the fall semester. Wish me luck!

Signing out,

~Orrin Wilson

Week 7 Progress

This week the DTSF team packed up and headed to Hamilton College for the DHI Conference. It was a Digital Technology Conference. Three schools attended the conference: Gettysburg, Hamilton, and Colgate. We brought the most modeling students out of the other schools. Hamilton was more interested in Unity and Colgate was using 3DSMax, an architectural program, to create their projects. The leaders of the Conference were both experts in Unity and Blender. It was a very inspiring experience to be able to learn from them and I hope to be able to use them as a resource for further questions I have in the future.

As far as the project Hoang and I were assigned, our goal was to recreate a Spanish theater from 17th century Madrid. This project was a very amazing experience and I learned a lot from it looking back. It taught me a lot about team collaboration and project workflow. The most important lesson I got from this was that things don’t always go to plan.

The first step was to figure out how we were going to split up the work. Both Hoang and I have spent a lot of time on Blender but neither of us have collaborated with another person on the same blender project. So we decided to split the theater into two sections. I worked on the front stage and side seating while Hoang worked on the back part of the theater where the people entered from. Both parts were complex in their own way. The theater has so many different levels and areas of seating at some points it was confusing. For me the backstage area was the most complex part for me because I never worked on an interior section of a model that is also attached to the exterior. When I designed the interior for Penn Hall, I created the interior separate from the exterior in a different Blender file. However while I was designing the backstage it was less intimidating that I originally thought. Hoang also had a difficult task. My section of the project was mostly symmetrical. This allowed me to use the mirror tool in Blender which meant I essentially only had to model half of the front which made things simpler. Hoang, however, was not able to use this because the entrance building is not symmetrical enough to get away with this tool.

After each of our base models were done, we began to go back and add more detail to the model. This included things such as benches, bleachers, banisters, etc. Once the specific model was made for each detailed furniture item, we then had to use the historical information Chris from the Spanish department found regarding how much furniture there was and where it was placed. Getting measurements to be as exact as possible was the most important part of this project. Especially because Hoang and I had to eventually combine our projects. This meant all of our measurements had to remain consistent between the two projects.

After the first day I quickly realized that the work was going to be much more than can be done in a week. So Hoang and I started to work nights in order to stay on schedule. However, even with this extra time, we still weren’t able to finish within the week. We were able to finish the majority of the Blender model excluding the textures.

Going forward we still need to properly transfer the Blender model to Unity along with the textures. There are also things in the model that need to be improved. There are also aspects to add in the future such as a realistic play interacting on the stage.

WEEK 8 (July 23-27th) – Last week

I truly can not believe that my internship as a Digital Technology Fellow is almost over – this Friday will be my last day. I feel as though I just arrived on campus for this internship! What will I do when I return home and am no longer spending most of my days at The Hub in West Building?

The Final presentations went very well! Despite the fact that it was raining, there was a nice crowd that came to listen to our presentations. I was very proud to present my project to everyone! The other DTSF fellows and I spent many hours with Director Remy rehearsing and perfect our presentations. I’m very glad that those hours paid off! Because the camera in the lyceum room was having a view technological issues, I rerecording my speech so that my family back home could also watch me present. An entire version of my speech is posted online!

This summer I accomplished my goal of earning my FAA license as well as creating photogrammetry models and using a CNC machine to create wooden replicas of the models. I am even working with Gettysburg College on emergency protocol and flood management which was my stretch goal! However, I did not get to use the total station to double check my elevation levels as planned but that is completely okay!

It is very bittersweet to say that my summer as a DTSF intern is almost over. However, I am more that greatful for the tremendous opportunities it has provided for me as well as the connections I have built with so many fantastic, experienced individuals. I will strive to continue working with photogrammetry and digital media whenever possible as I continue my environmental science concentration in GIS and my minor in computer science!

I would like to extend a sincere thank you to Director Remy as well as the I.T Department for allowing me to have this phenomenal opportunity. I would also like to extend a special thank you for Hoang, Orrin, and Tyler for working so closely with me and helping to make this such a wonderful, positive experience. Thank you! This experience was definitely one to remember!

Do great work!

Let’s Connect on LinkedIn

and Twitter!

Me presenting the various digital terrain models for different areas of Gettysburg College.

Evaluating Flood Patterns Through Technology on a rainy day? Perfect!

Passing out my wooden models made by the Carvey Inventables 3D Carving Machine so the audience can feel the different elevation levels.

Week7- Immersive Technology

Hello Everyone,

This week, I attended the Immersive Technology Conference at Hamilton College to learn and share knowledge about immersive technology which included 3D modelling, Virtual Reality, 360 videos, 3D scanning, and photogrammetry. Read more about it: here.

I learned many projects from different students from both Hamilton College and Colgate University. All of these projects were impressive, and I found out that I have still a lot to learn, e.g. the 3D model can be very detailed and can take a lot of time, VR experience can be even more interactive, which together can make the experience even more immersive 😉

My main goal this week was to reconstruct the Spanish theater, EL CORRAL DEL PRÍNCIPE, which existed between 16th an 18th century. Under commands of Chris Oechler (Profe O.), I and Orrin were trying to build 3D model of this theater in Blender and implement it in Unity in order to make the VR experience of the historical theater.

Theater consisted of that stage, two side walls, and the back. Orrin is more efficient in Blender than I am,  so he took the stage and two side walls, and I took the back of the theater. Because the theater consisted of 4 floors, I divided my work into layers (each layer- each floor), so that I could build at least 1 floor each day (4 floors- 4 layers- 4 days).

On the last day, I and Orrin tried to merge two projects together and there was a problem with the roof, because it covered all of the 4 floor, making impossible to see the stage from the 4th floor, so we had rearrange the roof again. At the end, we could finally fix it and we could put the 3D model to Unity and experience it in VR. Right now, the theater is just a grey 3D model, without colors. The next step will be adding the material and texture to the 3D model to make it look more realistic.

Thank you R.C., Profe O., and Eric for the trip and hanging out with us 😀 It was a very unforgettable experience for me. I really enjoyed working and spending time with you guys! Thank you Lord Greg from DHi Hamilton College for hosting us and teaching us important functions in Blender and Unity.

Thank you Profe O. for allowing me to work in your project. Hope that I was not that bad in cooperating.

Thanks Orrin for working with me and helping me. Happy Birthday!!!

Thanks Alyssa for proudly representing our school!

 

Have a good weekend,

JHA

P.S. I still think our school should have some squash court.

WEEK 7 (16-20th)

The Immersive Technology Conference at Hamilton College was an amazing experience that allowed me to connect and learn from a plethora of talented students and staff members from Hamilton, Gettysburg, and Colgate College! I must admit that I was a bit nervous to speak and interact with such an experienced and older group but after I soon learned how friendly, open, and genuine everyone was my interactions with them became more articulate and immersive. On the first day of the conference I demonstrated the proper functions and controls of operating a small unmanned aircraft vehicle and the crowd loved it! I received much praise on my presentation with the drone which made me feel very proud with my project regarding the fact that the compliments came from individuals who I truly look up to!

 

My demonstration of operating an unmanned aircraft vehicle to the staff, professors, and students at the Immersive Technology conference.

 

I learned about various projects students and faculty have worked on including a bird ecology lab, empathy projects, GIS DEM mapping, and architectural construction of a library in virtual reality! It amazes me to see how all of the projects have come along including my own! This week I sent my orchard models to Tyler back in Gettysburg. Director Remy helped me edit my models in Meshmixer so that they would have a solid foundation stand before they were sent to the 3D printer. Tyler has informed us that the Orchard 3 model printed out very nicely.

 

Various types of 360° cameras such as the Freedom 360, Kolar Abyss, and the Samsung Gear 360.

Mr.Doug Higgens from Hamilton College and I even spoke about me helping him with a photogrammetry project in the future to compare and contrast different programs to reveal their strengths and weaknesses. I am very excited about this opportunity as well as having the chance to continue working with photogrammetry!

 

Flying the Mavic Pro drone after a heavy thunderstorm.

I was also extremely impressed and fascinated by Adam Silcott’s virtual reality program demonstrating flood levels from a  hurricane in San Juan. Never would I have imagined to see GIS and virtual reality combined and integrated together so flawlessly. I also noticed that Adam used a program called City Engine for city design and planning which I was curious about. I wonder if there is an online demo for this program that I could possibly try? That may be very useful in my future endeavors with GIS and computer science.

Overall, my experience at the Hamilton conference was extremely positive and inspiring. I was even able to try on Hollow Lenses which incorporates augmented reality into creating games and such. I was so amazed! This week I worked on editing my previous three orchard models from Gettysburg as well as creating four new models from Hamilton College. Next week after my final presentation I will use my leftover time to create another model of the steepest terrain from Hamilton. I am very excited for what is to come!

 

The Hamilton College Campus – photo taken with the Mavic Pro drone.

 

 

This Week’s Models – Gettysburg, PA

 

https://skfb.ly/6AvIM

 

https://skfb.ly/6AuSZ

 

 

Hamilton College, NY

 

https://skfb.ly/6AuWS

 

https://skfb.ly/6AwEw

 

https://skfb.ly/6AvJv

 

 

The Photogrammetry Process…Broken Down!

Points of view of residence and terrain in ortrhomosaic, aerial point of view (top left) and digital surface model, DSM, (top right). Map view of photos taken including geolocated coordiantes (bottom left) and rayCloud view of drone path and angles used to create model (bottom right).

 

 

Week 6 Update

Overview


With the presentation date fast approaching, I knew that at this point it was important for me to start wrapping up the project and creating some working prototypes of my insulin pump.

Day 1


Now that I have completed my Python program that will run my insulin pump, it is now time to test a couple different pumping mechanisms that I have found under the thingiverse.com keyword ‘motorized syringe push’. Much of the day was spent making tweaks to the designs and trying to find which design would work best for my insulin pump.

Day 2


On the second day potential disaster struck, but before I get to that I do have good news. After my testing of designs on day one, I have come to the conclusion that this design would work best:This design works off of an rack and pinion set up (explained here) to push the insulin out of a reservoir tube (the container that holds the insulin). This is the only design that produced repeatable results, and in biotechnology consistency is key, so that is why I chose this design.

On to the bad news. Apparently Gettysburg College has been making some changes to its firewall, and my mechanism of pulling data from my database in the cloud has tripped the updated firewall, preventing me from getting any data from the cloud. Unfortunately this issue is impossible for myself to fix, however, I am working with Eric Yurick to help sort out the issue.

Day 3 and 4


While my program was down, I figured that it was important to try and calibrate the pump to actually pump close to the desired amount of insulin. This insulin pump will never actually be connected to someone (because of the dangers it presents), and each person responds to insulin therapy in different ways, so there is no true way to have it perfectly calibrated to someone (and I guess it really doesn’t need to be). With that in mind, I have decided that I will calibrate it to mimic the current insulin settings that I use. To do this I am tinkering with the stepper motor steps and measuring the amount of insulin (I am using water for testing purposes) that is output.

On day three we also had practice presentations with what we have completed so far. Without effectively communicating what you have produced, the technology that you make little impact, so presentation is very important to me. I am now getting more comfortable talking about my project and dialing in the presentation.

Day 5


On day five the network issue has yet to be resolved, however I am meeting again with Eric Yurick on Monday to try and figure it out (thanks Eric!). Until I am able to see how the pump responds to different blood sugar values, I cannot calibrate the pump anymore, so it is back to creating prototypes and testing using the 3D printer. I will update all on the network issues and final designs in next weeks post!

Week 6 Progress

This was our last full week to work on our projects. Next week we are off to Hamilton College to work on the virtual reconstruction of a Spanish Theater. I am very exited to test what I’ve learned to see what I can do to help others. To be honest this week was pretty stressful for me because I really wanted to finish my project this week so I can relax going to Hamilton and only focus on the presentation on Week 8. I worked around 10 hours a day this week. I am happy to report that my project is almost done. I am 99% finished with my Modern Penn Hall scene and my 1832 Penn Hall scene is almost done as well. All that is left is to do some touch up work and possibly add some historical information the user could read. I am confident I can finish this during my free time at Hamilton or right when we return. I hope to learn a lot from Hamilton. Because the conference is mainly focused on what I have been working on this whole summer, I am looking forward to talking to experts on the topic to learn more about Unity development. After this internship I hope to be able to take what I’ve learned and try to develop something fun and useful in VR.

Getting into more specifics as to what I’ve accomplished this week, I started off the week completing the final edits of penn hall and getting it ready to export to Unity. I made this process very tedious and inefficient. If I did it again it would only take half of the time. Every time I wanted to make an edit, it would change the texture map, so I would have to go back and re-wrap the texture to the model. Right once
I got everything wrapped up, I found another flaw with the model, that could only be seen up close in the Vive. This meant I had to go back into blender and do everything all over again. It was probably the most agonizing part of my project. Next time I won’t even bother wrapping the model until I approve of everything with a Vive walk through.

One of my debates was how to create a border for my project. Because I was only modeling a 50 meter radius around Penn Hall, the terrain just went into nothingness and it made the scene look very empty. I decided to look into creating a water border. It looks very beautiful and it doesn’t distract from the main scene. To add a feel of land going into the distance, I added a ring of trees on the other side of the water.

I am happy with how the scene turned out. I plan on showing this scene to my peers to see if there is anything I missed. I am open to criticism and improvement. It is far from perfect compared to a professional development company, but for a Undergrad Project I think it is a good way of combining all the skills I learned in the past 6 weeks.

 

Week6 – Almost done

Hello Everyone,

What a story, a 4.5 million population country, Croatia, is one step from being the World Champions. France is a very young, talented, and organized team. Croatia is brave, strong, and stable. Any outcome of this final match will be a good outcome.

Day1


I made more models of the tombstones in Blender in order to match different types of tombstones of Lincoln Cemetery. I found out that there so many types of tombstones and these pieces of rock are not cheap.

Day2


I started adding tombstones to my scene in Unity. I divided the cemetery into rows, so it would be easier for me to place the tombstones. Also, thanks to my drone photogrammetry of the cemetery I did last week, it showed the 3d (more exact) position and shape of each tombstone.

Lincoln Cemetery in Unity: 3D model (left) vs drone photogrammetry (right)

 

Day3


I still added the tombstones. I have to place them very precisely, so that later there will be space for other tombstones.

P.S. My tennis idol lost on Wednesday, I was so sad that almost lost the motivation to work.

Day4


I finished adding the tombstones with trees and bushes.

Day5


I worked on interactivity in Unity. I added teleportation, portal teleportation, and my photogrammetry model along with 3D model. Although, the computer I am working on is strong, it could not handle with tombstones, which consisted of million of polygons. Therefore, I have to work on improving the tombstone shapes by decreasing the number of polygons, so that the computer can handle with rendering the tombstones.

Also I made some 360 videos of the cemetery, allowing the user to experience more real.

 

Have a good weekend,

JHA