3D Digital Modeling – Week 3 of 3

Introduction

During week two, I realized I needed to find a program that was created with small object 3D model generation in mind. Pix4D requires a lot of manual intervention; adding and identifying tie points, manually sculpting models and calibrating uncalibrated cameras was time consuming, and tedious. Additionally, because the program generates the model in two steps; tie points, and point cloud & mesh, when additional cameras are calibrated, new tie points are added, or anything is done to the basic skeletal structure of the model, the tie point identification and rendering process needs to be reoptimized. Thus, discarding any work that may have been done on the point cloud and mesh, which makes up the texture and observable surface of the 3D digital model that can be manipulated in Sketchfab. This would not be a problem if the program did not confuse the background with the object’s edges. Because Pix4D identifies and adds points to the point cloud from the white background along some edges of the object undergoing rendering, the triangular mesh looks like it has white or off-white obtrusions or growths sprouting from edges or sides. When this occurs, I needed to manually delete each point on the point cloud to stop that point from showing a texture in the final manipulable 3D mesh. This was extremely time consuming, and the points deleted could also could be discarded if any changes were made to the tie points later on. For these reasons, Eric suggested I switch to Autodesk Remake for week 3 of my internship, and explore whether that program would be any more efficient.

Goals of Week 3

Because I changed my digital model generation software from Pix4D to Autodesk Remake, there was some learning about the program that needed to be done. But the main goal stayed the same; to produce high quality 3D digital models of the artifacts provided by Gettysburg College Special Collections. Fortunately, Autodesk is free to students, and has a whole page of their website dedicated to 3D model construction on their website, complete with workflow videos. This was extremely helpful during my learning process, and expedited my mastery of the program tremendously. Additionally, I could immediately tell that Autodesk was more of a consumer software than Pix4D. It was more streamlined, required less directory information, tagging, and was more flexible image identification.This will prove to be very helpful in the future tutoring role, as the overarching reason for my internship this summer in IT is to learn these programs so that I may teach students during the year of their uses, and act as a liaison between the Art and IT departments.  Additionally, Remake made editing the generated 3D model much quicker and easier, with tools like ‘slice and fill’, which creates new, solid bases for the models, ‘sculpting’, which allows the user to manipulate the objects’ surfaces if the program has made mistakes, and ‘fill holes’, which allows the user to identify errors in the surface of the model, and fill the hole with a smooth or flat surface that replicates the color around it. Using Autodesk Remake, one can also use the ‘bridge gaps’ function, which allows a misconstrued edge to be bridged and filled similarly to ‘fill holes’.

After mastering Autodesk Remake, I conducted several trial renders at low quality, and was pleased to find that the models were all sensical, and adhered to their actual forms. After seeing this, I was able to successfully generate and edit the models that I had been assigned from week two, as well as an additional two new items from Special Collections; a Confucius statuette, and an Iron Dragon. Below I have attached the models and their corresponding pictures to give an idea of the accuracy achieved in the 3D model generation process (double-click to enlarge the images).

  • The Terracotta Warrior

 

 

 

 

 

 

 

 

 

The terracotta warrior sculpture generated well. Because of its earthen surface, it did not have a shiny, polished sheen that would confuse the software. Additionally, the bust did not have detailed, layered engravings or carvings that could produce varied shadows. This render was very successful, and achieved at high quality.

  • The Cricket Cage

The outside embossings of the cricket cage rendered well, however the intricate engravings on the lid of the cage made the program do some guesswork, and produced shadows in the holes of the carved flower bed atop the lid that would shift and change when the object was rotated on the turntable. Additionally, because the ivory is polished to a sheen, tone can see that the object was confused by the flowers on the lid. This produced a lid that gets the idea across, but fails to convey the true craftsmanship and beauty of the ornamental lid.

  • The Rhinoceros Horn

This ornamental carved rhino horn rendered beautifully, and the details of the engravings on the sides were captured well. While the true detail of the rhino horn can only be fully appreciated in person with the actual artifact, this 3D digital model would serve well for studying the fragile item in an academic setting. All of of its engravings are distinguishable, and easily identified.

  • The Confucius Statuette 

 

 

 

 

 

 

 

 

 

 

The Confucius statuette was another very well produced model. The detail in the folds of his cloak, and the embroidery on his clothing, as well as his facial expression are all not lost in the digital 3D model. The digital statuette looks very close to its original physical copy, and its replication is really only signified by some editing done on the head and staff.

The Dragon

I really wanted the dragon to come out as good as the other models, it was my favorite artifact to work with. However, because it is made of iron, it gives off a sheen when photographed under bright lighting conditions. This caused some error when rendering with the Autodesk Remake software, and it can be seen in the white areas that seems to attach themselves to some of the edges of the dragon, particularly in places with fine detail, such as the horns, feet and teeth.

Conclusion

I have definitely accomplished my goals of learning and mastering photogrammetry and 3D model generation. Additionally, I’ve learned a great deal about photography, photo editing and Photoshop during my time working with Eric Remy and the IT department. I’ve mastered the skills required to manipulate and render a digital 3D model through both Pix4D and Autodesk Remake. My time has been filled with problem solving, and hands-on autonomous learning. I feel I have definitely acquired the skills to become an effective liaison between the Art and IT departments here at Gettysburg College. I look forward to continuing my work during the school year through tutoring or teaching assistant positions. Through my own trial and error, and innumerable renders of models, I’ve found a good start to finish system to create or replicate a digital 3D model. A fair amount of know-how is involved, as the type of object being photographed or created plays an important role in the lighting setup, and photography process, as well as it does with Photoshop and Pix4D or Autodesk Remake. I look forward to continue learning and honing my proficiency with these tools and programs, and to passing on what I’ve learned to other students and professors.

I would like to thank Eric Remy and the IT department for his help in making my internship this summer possible, without their resources and his knowledge, I would not have gone this far. I would also like to thank the DTSF group, especially Ryan Gonzalez ’19 for his help in getting me up to speed with photogrammetry. They did a wonderful job of ensuring I hit the ground running during my first week. Finally, I would like to thank Professor Tina Gebhardt for nominating me for this position, without her belief in me, I would still be unversed in this new link and application for technology in the art world, and vice versa. I cannot wait to see what applications my work will have looking forward, and I look forward to being able to continue learning in this field.

St. John Smith ’20

3D Digital Modeling – Week 2 of 3

Introduction

During week one, I learned the basics of 3D digital modeling, 3D printing, with an overview of how the coding and settings of the programs should be set up. Viewing the final project presentations of the DTSF group was a good way for me to end my first week, and answer any technical questions I still had. Their projects solidified what I had learned. However, week two brought another challenge; autonomy. The Fellows were no longer in IT to answer questions, or help problem solve when errors arose. Figuring out my way around Pix4D, Adobe Photoshop, and a new camera, the Nikon D810 was a great way to learn to master the new tools I needed to accomplish my tasks. During week two I was able to become quite proficient with these technologies and equipment, and embellished my photography setup in Special Collections with a new LED ring light, and fully shadowless image capture, which creates pictures that give the Pix4D modeling software limited room for error, and thus expedite the rendering process.

Goals

On Monday, Eric Remy, Director of Instructional and Educational Technology of Gettysburg College, and I met with Carolyn Sautter, Director of Special Collections, and Catherine Perry, Digital Projects Coordinator & Collections Manager. We reviewed the Chinese art pieces, many of which are from the 19th century, which were being considered for 3D digital modeling, and troubleshot potential problems their shapes and physical surfaces might present to the image capture and rendering process. During the second week, the goal was to render 3 digital models, which were to be produced from an ivory-lidded ornamental cricket cage, carved rhino horn, and terracotta sculpture of an ancient Chinese warrior’s head.

Ornamental Cricket Cage

Carved Rhino Horn

Terracotta Warrior Head

 

Accomplishments of Week 2

Because the bottoms of the rhino horn and terracotta warrior sculpture were unadorned and partially hollow, they were suited for a rendering that included a turntable with a digitally tagged surface would produce better renders, even though they wouldn’t render the bottoms of the items. However, for the cricket cage I tried to get all sides using a blank turntable and background, as I did with the trilobite during week one. But when I rendered those untagged images through Pix4D, the different angles were unable to mesh, and produced a digital model that was only 70% of the circumference of the model, it did not create a full 360° model. After retaking images of the cricket cage, the rendering process was very long, and had some errors because of the cage’s symmetrical design and engravings. The program was having trouble recognizing that it was a cylindrical object, and would fail to produce a fully rendered, meshed image of the cricket cage. Therefore, this week was mostly comprised of trial and error practice renders. I experimented with lighting conditions picture angles, manual tie points, and project merging.

Using large batch automation, and  droplets on Photoshop, I created directives by which Photoshop would automatically edit the contrast, color and brightness of the pictures, and save the hundreds of photos to a USB drive. In doing this, I ensured that the lighting of the pictures would be consistent in all of the cameras generated by Pix4D. Editing the contrast or color of the pictures also allowed certain features to stand out by sharpening the quality, and accentuating edges and standout features that the program could easily identify in the editing process.

Week 2 was important for my learning curve, as I became really familiar with the work I was doing, and how to operate the software efficiently. I determined that while Pix4D is a great orthographic mapper, it struggles with shiny objects, as well as items that have black components. Additionally, Pix4D has a lot of trouble merging two angles of an object together, even when manual tie points are identified in every picture. The program also uncalibrates certain cameras – or pictures – automatically. For some reason, the program will favor one side or angle of an object more than another, and produce a 3D model that does not have all sides, or has holes. This was the problem I kept having over and over with the terracotta warrior, and cricket cage.

Conclusions from Week 2

Week two definitely really solidified my expertise using Pix4D, and was a week of simplifying the image capture and model generation process. My attempts during most of this week created disjointed objects, or objects with holes. The main issue that I was having was that the Pix4D program was really designed for orthographic models, and not small objects. The examples hosted on the Pix4D customer support were good, and the workflows made sense, but all of the examples used renders that implemented pictures from drone flights, mapping buildings or landscapes. Because the program is not designed to deal with the intricacies of small object rendering, it struggled with depth perception, and recognizing that the shadows of fine details changed when the object turned.

Eric and I concluded that it was best to search for another program to model the items Special Collections had given us, and we found Autodesk Remake at the end of the week, it is specially designed to make 3D digital models of small objects.

 

3D Digital Modelling – Week 1 of 3

My name is St. John Smith, I’m entering my sophomore year at Gettysburg College, and intend to declare as an Organizational Management Studies major. The purpose of my research and work will be to learn the intricacies of photgrammetry, as well as to be able to adapt the 3D models I will create using the Pix4D photogrammetry 3D model generation software, and render the final results into SketchFab for public reference. My work will primarily focus on capturing photographs of items in Gettysburg College’s Special Collections Department, which are either too fragile or expensive to handle in an academic setting, and then render the images through Pix4D, making appropriate edits, and uploading the finished digital 3D models into SketchFab, an easily accessible platform for students to manipulate and study the virtual models, while keeping the originals safely intact.

Goals and Introductions 

The first week of my internship was an introductory phase. I shadowed Gettysburg’s Digital Technology Scholarship Fellows (DTSF), and learned the ins and outs of each of their specialized interests. From Ryan Gonzalez ’19, I learned how to use the Pix4D program, and create my first digital 3D models. I spent the majority of my time focusing on mastering Pix4D while Ryan was still at Gettysburg, as its use and software would be what I needed most in the coming weeks, using it to capture artifacts and models from Special Collections. Ryan also walked me through several test flights using the Information Technology Department’s DJI Mavic Pro Drone. This drone pairs with the user’s smartphone, allowing one to program flights for the drone to follow using the Pix4D mobile companion app to take hundreds of pictures of a subject. The drone can follow grid, double grid, circular, or manually flown flights, all while pointed at a subject, and capturing 4K resolution images to later be transferred and rendered on the PC Pix4D software. After learning to fly the drone, Ryan supervised my own flights, during which I captured Gettysburg’s Jaeger Center for Athletics, and produced a digital 3D model, shown below.

Jonathan Trilleras ’20 showed me the basics of 3D printing, and illustrated through test prints and demos the differences between the PLA printers and the high-end resin slicing printer. James Arps ’18 helped me to grasp the usefulness and workings of the Octoprint program as well, which allows the user to 3D print wirelessly via an internet connection.

Accomplishments of Week 1

As the week progressed, I began to work more autonomously, occasionally seeking out my peers and mentor, Eric Remy for advice. Using what I learned from Ryan, I began to address a problem he had been having with Pix4D. It was very hard to render all sides of an object, and the program would generate an image that was disjointed or separated and unaligned. This issue was of less importance to Ryan and his research than to myself, as my primary responsibility would be to render artifacts and decorated objects of significant worth, for which a 360° rendering would be very important. Unfortunately, the official Pix4D small object rendering how-to guide was proving useless. The directions instructed us to place our small object on a tagged turntable, then rotate the object and then reposition it on a different side and rotate it again so as to capture images of all sides of it (seen below).

  However, after much trial and error, I discovered that the software was using the tags on the turntable more frequently as tether points than on the actual object itself, therefore not recognizing that the object was placed on its side, and caused the two images to fuse together, which produced a convoluted 3D rendering.

To remedy this issue, I replaced the turntable covering recommended by Pix4D with a blank white turntable when attempting to render a complete 360° model of a fossilized trilobite.

After retaking pictures of all of the previous angles and rotations, The trilobite render worked flawlessly, and produced a completed digital 3D model, which I then uploaded onto Sketchfab (seen below). 

 

Looking Forward

This week was very helpful, I especially appreciate the help I received from my peers in the DTSF program, without them I would not be as knowledgeable, nor as proficient as I have become with the software and processes of producing digital 3D models. I look forward to working with the Special Collections Department in the coming weeks, and helping them digitize their fragile and valuable items. I’m still attempting to find a solution to a problem I’ve found with black and shiny objects. Pix4D misinterprets them due to their reflective sheen, and mistakes the black for negative space most of the time, this is a problem I will continue to attempt to solve next week by using more models and trying different settings in the imaging and processing options of Pix4D.