to serve, support, and collaborate with faculty, students, and industry to be a leader in scientific visualization,and human computer interaction, through learning, discovery, and engagement.
A team of graduate and undergraduate students led by Prof. Nicoletta Adamo-Villani from CGT and Prof. Mete Sozen from CE used cutting edge 3D animation technology to visualize a futuristic city....
The learning of abstract concepts associated with many topics in the STEM disciplines often requires students to develop an active mental model of the phenomenon under investigation...
118 buildings of West Lafayette Campus are created.3D Models include all Academic and Administrative buildings as well as a couple parks and the major Athletics facilities....
The goal of the Exploratorium is to enhance research, classroom and museum learning via interaction with the life-size or scaled down, desktop based, virtual reality models of the ancient environments...
This study will determine how well people plan a tour through a set of points within a real world setting, and will compare the results with those in a virtual environment...
The Envision Center, in partnership with the Patti and Rusty Rueff Department of Visual and Performing Arts (VPA) has accepted an invitation to participate in the OISTAT...
The Envision Center's Virtual Campus is an ongoing recreation of the Purdue campus. It is used as the primary demonstration program of the FLEX cave's capability to create a virtual environment...
we have been exploring different ways of applying haptic force feedback in reasonably simple concepts with the intention of understanding effectiveness of the additional haptic channel in the learning process. In particular, we are interested in understanding in what meticulous ways the introduction of haptic force feedback enhances learning....
We are developing an immersive learning environment for deaf children. We are adapting the Mathsigner application for display and interaction in the FLEX...
The computer graphics profession, particularly the educational component, takes into account a person's spatial abilities as a means for designing effective instructional experiences and assessments...
AGJuggler consists of a set of libraries that provide routines and functions that allow geographically distant Access Grid nodes to connect to and share the same virtual reality space...
In this project we are developing a streamlined methodology for creating digital immersive examples to showcase the capabilities of an immersive virtual environment for product lifecycle management (PLM)...
We have developed a prototype 3D photorealistic virtual laboratory for undergraduate instruction in microcontroller technology. The web/CD deliverable lab operates and produces results equivalent to the physical laboratory and is, to our knowledge, the most realistic and advanced computer-simulated laboratory developed so far for microcontroller instruction...
With the high powered rendering systems and recording equipment available today, 4k video streams are now within the reach of several scientific communities...
TJ's efforts are primarily focused on the design and creation of innovative learning spaces of the future. By leveraging the power and flexibility of emerging computer graphics techniques and network computing, a day is envisioned where traditional constraints between time/space and viewer/viewed dissolve within the boundaries of persistent, distributed, real-time, presentational spaces...
Participants use the Envision Center's FLEX to immerse themselves in the modeled environment which includes realistic environmental settings and mobile organisms...
We have developed a new method of sign language subtitling aimed at young deaf children who have not acquired reading skills yet, and can communicate only via signs ...
This semester this Envision Discoverers are continuing their work with VPA to create an environment for choreographers to visual design their dance pieces...
Our project is an immersive scientific visualization and visual analytics application being developed with the School of Chemical Engineering as part of the Center for Catalyst Design...
The goal of this project is to address various challenges in bio-terror crises communication by developing an innovative crisis communication training module for public relations students...
In the search for cancer protein biomarkers, traces or signatures of a significant biological process, LC/MS is employed to analyze proteins based on a comparison of protein samples ...
Research aimed at determining which variables in a VE affect time perception. An initial experiment has already been run and determined that navigation speed seems to have a correlation with time perception. The faster a user moves while in a VE, the faster times seems to progress...
Ongoing
The Impact of Computer Simulated Haptic Force Feedback on Physics Concept Learning: Understanding Electrostatic and Electromagnetic Fields Through Haptic feedback
Major adviser: Dr. Gary R. Bertoline
Advisers: Dr. Hong Z. Tan, Dr. Laura L. Arns, and Dr. Craig L. Miller
PhD candidate: Enkhtuvshin Dorjgotov
Learning of physics concepts often requires students to develop an active mental model of the phenomenon under investigation. Traditional instruction is largely based on analytical equations and methods of calculus. Developing an active mental model of abstract physics concept from analytical equations is the fundamental challenge for students (Laws et al., 1999). Evidences (Brooks et al., 1990; Reiner, 1999) suggested that physics concept simulations with haptic feedback are capable of providing intuitive mental model of the abstract physics concepts. In this study, using computer graphics and haptics technology, we are investigating effect of haptic force feedback in learning of physics concepts. The preliminary results indicated that the addition of haptic feedback in physics concept simulations has a potential for deeper and more engaging learning experience.
Istanbul, a port city that has served as the capital of two successive great empires and is currently the economic hub of the Turkish Republic, has a rendezvous with fate. Devastating earthquakes have visited it in the past at intervals varying from 300 to 100 years and the next one is due any moment. In the next earthquake, the conditions of engagement will be dramatically different from those in the previous catastrophic events. Instead of a population of less than one million with most of its inhabitants housed in timber construction, the current city is home to over 12 million living in brittle concrete and masonry housing. The Metropolitan Municipality of Istanbul is planning for response to and recovery from the dreaded event in many modes. One of these is the development of an entirely new satellite city.
The vision of the new city has been created at the Envision Center for Data Perceptualization at Purdue University by a team of graduate and undergraduate students led by Prof. Nicoletta Adamo-Villani from CGT and Prof. Mete Sozen from CE. The team used cutting edge 3D animation technology to visualize the futuristic city.
The project presented many challenges because of its complexity, the scale of the area to be visualized (an area of 40,000 acres that will eventually be home to 1.5 million residents), and the aggressive production timeline (2 months to deliver a 5-minute 3D fly-thorough of the entire city). The overall city plan was developed by Dr. Sozen with the goal of creating a green city with an advanced cyber infrastructure dedicated to communications, security, and recycling. The plan includes a business district with headquarters for banks, corporations and insurance companies, research and government centers, modern museums, concert halls, theaters, hospitals, retail centers, exhibition halls, buildings for social functions, a sports center, and a hotel district with more than 60,000 rooms and suites for visitors. Above all, all construction will be earthquake resistant.
Department of Engineering Education ´ s Young Engineer Studies (YES)
The Impact of Computer Simulated Haptic Force Feedback on Learning
PI: Dr. Gary Bertoline, Computer Graphics Technology & Envision Center, Purdue University
Co-PI: Dr. Hong Z. Tan, ECE & Envision Center, Purdue University
Research Assistants: Enkhtuvshin Dorjgotov, Envision Center, Purdue University
Research Assistants: Sumanth Peddamatham, ECE & Envision Center, Purdue University
Funding Source:
Engineering Education ' s Young Engineer Studies (YES) Seed Grant Funding for 2007-2008 Purdue University
The learning of abstract concepts associated with many topics in the STEM disciplines often requires students to develop an active mental model of the phenomenon under investigation. Frequently, this active mental model of phenomenon consists of highly visual and haptic components since force and force fields are central to the learning of many engineering and scientific topics. Traditional instruction is largely based on analytical equations and methods of calculus. This traditional instruction in physics fails to provide students with a sound conceptual grasp of basic physics principles.
Developing an active mental model of abstract concepts from analytical equations is the fundamental challenge for students who are going through traditional engineering and science instruction. However, recent advances in computer graphics, virtual reality, and haptics technology have opened a whole new avenue for teaching and learning abstract concepts through simulated multimodal virtual environments. Some early evidence suggests that haptic force feedback augmented physics concept simulations are capable of enhancing learning of abstract physics concepts by allowing students to visually and haptically experience the physics phenomenon. Thus, haptic force feedback augmented physics concept simulation is capable of providing students with the interactive mental model of underlying physics concept. We believe that the use of haptics in virtual reality simulations has the potential for deeper and more engaging learning of abstract concepts for PreK-6 learners. In the scope of the project, we are developing various haptic force feedback augmented physics concept simulations that may help PreK-6 students more effectively integrate the visual and haptic information and develop a more complete mental model of the concept.
Dr.Gary Bertoline, Computer Graphics Technology & Envision Center, Purdue University
Meiqi Ren Envision Center, Purdue University
Timothy Rogers Computer Graphics Technology & Envision Center, Purdue University
Andres Maldonado Computer Graphics Technology , Purdue University
Micah Bojrab Computer Graphics Technology , Purdue University
Carson James del Greco Computer Graphics Technology , Purdue University
Joseph Farris Computer Graphics Technology , Purdue University
Edward M Leisio Computer Graphics Technology , Purdue University
Kevin Polley Education, , Purdue University
Ryan Wilsey Computer Graphics Technology , Purdue University
James Blasdel Computer Graphics Technology , Purdue University
A group of students--working through the direction and support of Envision Center -- have created 100+ buildings of Purdue University's West Lafayette Campus and won the Google's Build Your Campus in 3D Competition. 3D Models include all Academic and Administrative buildings as well as a couple parks and the major Athletics facilities.
Dr. Bedrich Benes, Computer Graphics Technology & Envision Center, Purdue University
Ryan Pedela, Envision Center, Purdue University
In the search for cancer protein biomarkers, traces or signatures of a significant biological process, liquid-chromatography / mass spectrometry (LC/MS) is employed to analyze proteins based on a comparison of protein samples from healthy and malign individuals. Statistical analysis of the data generated by modern mass spectrometers is the classical technique used in biomarker detection, however this approach has several disadvantages. Given the large datasets (up to 100MB for a single LC/MS run), a single analysis can take several hours on a standard PC. A larger issue is that detected differences may not be related to disease, and scientists do not have an a priori idea what they are searching for. The ex post interpretation of the analysis results is an important step in biomarker detection research.
Visualization of LC/MS data can be useful to scientists in identifying suspicious subsets of data. This would give scientists an a priori idea what they are searching for, and would considerably reduce the size of data analyzed by classical techniques. A visualization tool is needed that can render, display, and manipulate multiple 3D representations of LC/MS data in real-time. Unfortunately current visualization and analysis tools fall short of this goal.
The goal of this project is to develop a visual analytic tool for LC/MS data using advanced computer graphics techniques and interface design. More specifically the goals are:
* Increase the accuracy of analysis.
* Decrease the time of analysis.
* Visualize multiple MS datasets in real-time.
* Integrate analysis techniques and visualize the results.
* Design and develop an intuitive user interface.
Imagine an online historical atlas where each historical event would be mapped and annotated with text, diagrams, pictures, videoclips, and audiofiles.
Imagine a site where people interested in the same historical events, places, monuments or periods can network.
Imagine a site that can automatically index information and create clusters of events, places or historical personalities based on the users' common interests in them.
Imagine a site that can recommend the best books or articles available for a specific historical topic.
Imagine a service that would deliver to your cell phone information about any spot on the planet you might find yourself near.
Imagine a room with life-size screens on which virtual models of the ancient Roman Forum, of the Omaha Beach Battle or of the Forbidden City would be projected and interacted with in 3d.
Now imagine people using cell phones, desktop or laptop computers, or full immersion 3d virtual reality models and talking to each other *through* the atlas, allowing them to share impressions, passions and ideas as they contribute, edit, or consume the atlas' contents.
Visible Past is a seamless system of information storage and retrieval that turns the idea of information searching on its head: spatially aware, read/write, and multi-user, Visible Past makes information search for you.
The Exploratorium is a cross platform, scalable research and learning environment designed to help students and scholars to experience and to communicate with fully immersive historically accurate models of past geographic realities or to relate information to specific real geographic locations. If fully immersive models are used, these can be visualized and interacted with in a number of settings: virtual reality theaters, webpages or geographic exploration interfaces, such as Google Earth or Worldwind.
The goal of the Exploratorium is to enhance research, classroom and museum learning via interaction with the life-size or scaled down, desktop based, virtual reality models of the ancient environments. Information is delivered in a narrative format via interaction with information repositories, located locally or on the Internet. The project is designed to extend and to validate a theoretical framework for humanities research and learning. It also aims to establish a set of methodological tools for virtual reality research and learning that can be extended to other environments and locations.
This study will determine how well people plan a tour through a set of points
within a real world setting, and will compare the results with those in a
virtual environment. The task of producing a shortest tour of n points (cities)
is known in applied mathematics as the Traveling Salesman Problem (TSP).
Despite the simplicity of the definition of the problem, finding the shortest
tour is difficult. As a result, this problem is considered by computer
scientists ¡°computationally intractable¡±. Interestingly, humans are known to
produce good solutions fairly quickly. TSP is closely related to a number of
tasks people routinely perform, such as visual navigation. Furthermore, TSP is
related to a number puzzles and problems people solve such as Tower of Hanoi, or
math and physics problems. This study will shed light on two aspects: human
ability to solve problems, and the relation between virtual reality and reality.
Visual and Performing Arts Faculty participants are:
Richard Thomas, Project Co-Director; Professor of Visual and Performing Arts, Theatre Sound, Head of Theatre Design and Technology
Carol Cunningham, Project Co-Director; Professor of Visual and Performing Arts, Dance, Chair of Dance Division
David Sigman, Professor of Visual and Performing Arts, Visual Communication Design, Head of VPA Department
Fabian Winker, Assistant Professor of Visual and Performing Arts, Art and Design Division, New Media
Envision staff participants are:
Dr. Laura Arns, Envision Center, Purdue University
Visual and Performing Arts student participants are:
Jason Ducat, Graduate Student in Theatre Sound Design, Sound Designer
Jason Knox, Graduate Student in Theatre Sound Design, Composer
Rob James, Graduate Student in Theatre Sound Design, Sound Design and Programming
Ron Shoemaker , Undergraduate Student in Theatre, Performer and Sound Designer
Christy Jacobs, Undergraduate Student in Art and Design, Performer and Visual Designer
Ingrid Schultz, Graduate Student in Art and Design, Visual Designer
Onur Yazicigil, Graduate Student in Art and Design, Visual Designer
Envision/CGT student participants are:
Matt Brisbin, CGT, Envision Center, Purdue University
The Envision Center, in partnership with the Patti and Rusty Rueff Department of Visual and Performing Arts (VPA) has accepted an invitation to participate in the OISTAT (International Organization of Scenographers, Theatre Architects and Technicians) Summer Scenofest at the Prague Quadrennial (PQ) June 14-24, 2007. The PQ is at once a place of investigation and communication as well as a place of celebration. The Prague Quadrennial Exhibition, together with its series of accompanying activities, creates a unique platform for seminars, workshops, and meetings of leading theatre practitioners from all over the world. Through the Design as Performance program, Purdue will bring to Prague a production that explores new directions in performance¡ªspecifically a theatre piece conceived, born, and performed by designers, rather than the more traditional theatre that begins with the playwright and a dramatic text.
The Envision Center's Virtual Campus is an ongoing recreation of the Purdue
campus. It is used as the primary demonstration program of the FLEX cave's
capability to create a virtual environment. As such, virtual campus is
constantly being improved and expanded to provide the best viewing experience
possible.
Granular Material Interactive Manipulation: Touching Sand with Haptic Feedback
Dr. Bedrich Benes, Computer Graphics Technology & Envision Center, Purdue University
Enkhtuvshin Dorjgotov,Computer Graphics Technology & Envision Center, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
Dr. Gary Bertoline, Envision Center, Purdue University
Real-time manipulation of surface geometry has been one of the interesting and challenging topics in computer graphics. Over the years, many terrain modeling techniques that mainly focused on realistic visual representation of a terrain have been developed. However, not mush work is done in a real-time interactive modeling with force and tactile feedback. In this project, we introduced an idea of manipulating a layer of sand with haptic device while feeling the actual force from the surface. The advantage of this new technique is that a user not only can see a visually realistic surface change but also perceive a realistic (physically modeled) haptic feedback. We use regular height-fields to store the model of the sand. During the project, we encountered a number of challenges in regard to unstable force feedback, decoupling of graphics and haptic servo loops and highly intensive and continuous surface erosion process. We addressed these challenges by using CHAI 3D finger-proxy point model, multi-threading, localized update and introducing distributed haptic rendering over TCP/IP network communication. Paper presented at the 2006 International Conferences in Central Europe on Computer Graphics, Visualization and Computer Vision.
Nicoletta Adamo-Villani, Computer Graphics Technology & Envision Center, Purdue University
Dr. Bedrich Benes, Computer Graphics Technology & Envision Center, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
Funded by an Envision Center Seed Grant
The main goal of this project is to use the motion capture suit to navigate and interact with a virtual environment. Instead of using a hand held (or similar) device, the user wears the mocap suit and interacts with the virtual environment with simple motions and body postures. An extension of this project is to use the mocap suit for real-time control of the motion of a 3D avatar in the FLEX.
Enkhtuvshin Dorjgotov,Computer Graphics Technology & Envision Center, Purdue University
Dr. Gary Bertoline, Envision Center, Purdue University
Dr. Hong Tan, Electrical and Computer Engineering, Purdue University
An Envision Center Project
In recent years, researchers in the haptics field began to realize the potential use of haptic force feedback in teaching a variety of physical concepts such as spring force, damping coefficient, static and dynamic frictions, magnetic force, and even nano-force. In this ongoing project, we have been exploring different ways of applying haptic force feedback in reasonably simple concepts with the intention of understanding effectiveness of the additional haptic channel in the learning process. In particular, we are interested in understanding in what meticulous ways the introduction of haptic force feedback enhances learning. So far, we are in the development stage of a spring force based prototype haptics application that simulates a force field inside a single walled carbon nanotube (SWCN). Currently, we are implementing a simple spring system that would help students understand the related physical forces through use of force feedback. Also a comprehensive literature review is being done on the topic. The ultimate goal is to measure the impact of haptics application in a concept learning if there is any.
Nicoletta Adamo-Villani, Computer Graphics Technology & Envision Center, Purdue University
Ed Carpenter, Computer Graphics Technology & Envision Center, Purdue University Department of Hearing Impairments
Ronnie Wilbur, Department of Hearing Impairments, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
Matt Brisbin, Computer Graphics Technology & Envision Center, Purdue University
Partially supported by NIH grant and funds from Dean Depew, College of Technology
We are developing an immersive learning environment for deaf children. We are adapting the Mathsigner application for display and interaction in the FLEX. The specific objectives of the work are: (1) display of Mathsigner seamless animated 3D signers in the FLEX ¨Cthis is a challenging problem, usually 3D characters for immersive applications are segmented, not seamless (2) implementation of a basic gesture control system which includes pinch gloves for input of ASL hand-shapes (we hope to be able to use the mocap gloves in the near future) and a 6 degrees-of-freedom tracker, and (3) realization of basic math interactive learning/testing activities. A brief demo was presented at the I-Light symposium in October. Two papers on this project have been accepted for publication: one to Siggraph--Educators Program and one to ASM 2006--International Conference on Applied Simulation and Modeling.
Developing a Virtual Reality-based Spatial Visualization Assessment Instrument
Dr. Nathan W. Hartman, Computer Graphics Technology, Purdue University
Dr. Gary Bertoline, Envision Center, Purdue University
Dr. Jeffrey W. Gilger, Education, Purdue University
Patrick E. Connolly, Computer Graphics Technology, Purdue University
Funded by Discovery Park Learning Center
The computer graphics profession, particularly the educational component, takes into account a person¡¯s spatial abilities as a means for designing effective instructional experiences and assessments. Typical assessments examine such abilities as mental rotations, spatial visualization, and spatial perception. Spatial visualization skills relative to a cutting plane passing through an object is critical in the use of in many computer graphics software tools. This ability is widely considered to be a significant predictor of probability of a person¡¯s success in the computer graphics vocation. The Mental Cutting Test (MCT) is an assessment instrument that is commonly used to measure spatial visualization skills. This instrument is currently available only in paper-and-pencil format. However, the nature of the human ability being measured is such that the paper-and-pencil format currently used has no mapping to the target construct domain ¨C namely 3D computer graphics in the real world. This lack of authenticity puts into serious question not only the perceived validity (face validity) of the test, but also the purposes for which test scores from the MCT are put to use (construct validity). In an effort to minimize these issues, the cognitive psychology and computer graphics communities have developed virtual reality-based versions of a mental rotations instrument to examine various constructs. But a mental rotations assessment does not provide a complete coverage of a person¡¯s spatial abilities. This project focuses on the development and methodology for pilot testing a working prototype of a virtual reality-based version of a spatial abilities assessment instrument which uses the MCT as a model.
Dioselin Gonzalez, Formerly with Envision Center, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
Ryan Pedela, Computer Graphics Technology & Envision Center, Purdue University
AGJuggler consists of a set of libraries that provide routines and functions that allow geographically distant Access Grid nodes to connect to and share the same virtual reality space. Each node has its own view of the virtual world using its virtual reality hardware system, but can see every other node in the virtual world. This will enable geographically distant locations to truly collaborate with each other. Some possible applications include: architects at distant geographical locations designing a building together, meeting to discuss the project and having a real-time, interactive exploration of their model; scientists visualizing data, sharing their observations from each one's point of view and making annotations; and artists having a distributed performance with actors in many locations and the audience immersed in the world with them. AGJuggler has been released to the AG community under an Open Source license.
Streamlined Methodology to Showcase PLM Projects in a Immersive Virtual Environments
Dr. Nathan W. Hartman, Computer Graphics Technology, Purdue University
Funded by Center for Advanced Manufacturing
In this project we are developing a streamlined methodology for creating digital immersive examples to showcase the capabilities of an immersive virtual environment for product lifecycle management (PLM). The hardware used in this research to develop the proposed methodology is a four-node PC cluster connected to a FlexTM(both VR Theater and CAVE®-like configurations) display system to create the virtual environment. We are examining three different software tracks to demonstrate our approach. Those three tracks are: (a) use of native computer aided design (CAD) ¨C Virtual Reality (VR) system, (b) use of non CAD-native commercially available VR system, and (c) a custom-built non CAD-native VR system. The creation process of 3D data used for the simulation and data exchange, the translation techniques used to convert 3D geometry between software applications, and the novelty of this streamlined approach for creating future immersive examples in a timely fashion consistent with the available hardware, software, and expertise are also being examined in the scope of this project.. The methodology designed and tested in this project will be used for educational purposes and made available to future students and faculty so that they will benefit from lessons learned during this initial creation process.
A glove-based interface for the Mathsigner application
Nicoletta Adamo-Villani, Computer Graphics Technology & Envision Center, Purdue University
Dr. Bedrich Benes, Computer Graphics Technology & Envision Center, Purdue University
Matt Brisbin, Computer Graphics Technology & Envision Center, Purdue University
Ronnie Wilbur
Partially supported by NIH grant and funds from Dean Depew, College of Technology
The goal of this project is to use the 18 sensor motion capture gloves as an input device for the desktop application. So far, the user can interact with the program only via mouse and keyboard. The gloves would give the child the ability to input the answers directly in sign language by forming the number hand shapes with the gloves. Since the gloves are extremely expensive, we are also considering other input devices such as the specialized keyboard for which Nicoletta has a pending patent and a toy hand with potentiometers (to be developed soon ). We are writing a paper to be submitted to Siggraph- Sketches
Dr. Laura Arns, Envision Center, Purdue University
Dr. Bedrich Benes, Computer Graphics Technology & Envision Center, Purdue University
Jenett Tillotson, Rosen Center for Advanced Computing, Purdue University
Preston Smith, Rosen Center for Advanced Computing, Purdue University
Jack Moreland. Computer Graphics Technology &Envision Center, Purdue University
Funded by NSF TeraGrid Grant and An Envision Center Project
The Teragrid Distributed Render Environment (TeraDRE) is a render farm implementation that has been created on the TeraGrid. The system uses open source Renderman-compliant software, Pixie, as well as Alias Maya for rendering scientific research and complex animations. Integrated with Madison Wisconsin¡¯s Condor batch scheduling software, users submit a job through custom software that we have written.
Photorealistic 3D Virtual Laboratory for Undergraduate Instruction in Microcontroller Technology
Nicoletta Adamo-Villani, Computer Graphics Technology & Envision Center, Purdue University
Prof. J. Richardson, ECET
Prof. G. Moore, ECET
Ed Carpenter, Computer Graphics Technology & Envision Center, Purdue University
Funded by ITaP TLT grant 2005
We have developed a prototype 3D photorealistic virtual laboratory for undergraduate instruction in microcontroller technology. The web/CD deliverable lab operates and produces results equivalent to the physical laboratory and is, to our knowledge, the most realistic and advanced computer-simulated laboratory developed so far for microcontroller instruction. We are currently assessing the efficacy of the application as a learning tool with a group of engineering students enrolled in ECET 209. A paper was submitted to Siggraph 2006-Educators Program, and one to Frontiers in Education 2006 Conference.
A new method of Sign language subtitling by highly comprehensible ´semantroids´
Nicoletta Adamo-Villani, Computer Graphics Technology & Envision Center, Purdue University
Dr. Gerardo Beni, UCR
Dr. Wilbur, Linguistics, Indiana School for the Deaf (ISD)
Partially supported by NIH grant and Discovery Award
We have developed a new method of sign language subtitling aimed at young deaf children who have not acquired reading skills yet, and can communicate only via signs (we hold a trademark and a pending patent). The method is based on: (1) the recently developed concept of ¡®semantroidTM¡¯ (an animated 3D avatar limited to head and hands); (2) the design, development, and psychophysical evaluation of a highly comprehensible model of the semantroid; and (3) the implementation of a new multi-window, scrolling captioning technique. Based on ¡®semantic intensity¡¯ estimates, we have enhanced the comprehensibility of the semantroid by: (i) the use of non-photorealistic rendering (NPR), and (ii) the creation of 3D face model with distinctive features. We then validated the comprehensibility of the semantroid through a series of tests on human subjects which assessed accuracy and speed of recognition of facial stimuli and hand gestures as a function of mode of representation and facial geometry. Test results show that, in the context of sign language subtitling (i.e., in limited space), the most comprehensible semantroid model is a toon-rendered model with distinctive facial features. Because of its enhanced comprehensibility, this type of semantroid can be scaled to fit in a very small area, so it is possible to display multiple captioning windows simultaneously. The concurrent display of several progressive animated signed sentences allows for review of information, a feature not present in any sign language subtitling method presented so far. As an example, we have applied the multi-window, scrolling captioning technique to a children¡¯s video of a chemistry experiment. We are in the process of testing the subtitling method at ISD. The project has been published extensively, with a journal article submitted to BJET in October.
Dr. Laura Arns, Envision Center, Purdue University
Jenett Tillotson, Rosen Center for Advanced Computing, Purdue University
Ryan Pedela, Envision Center, Purdue University
Michael Shuey, Rosen Center for Advanced Computing, Purdue University
Preston Smith, Rosen Center for Advanced Computing, Purdue University
Tom Hacker, CyberCenter, Purdue University
David Braum, Rosen Center for Advanced Computing, Purdue University
With the high powered rendering systems and recording equipment available today, 4k video streams are now within the reach of several scientific communities. A resolution of 4096x3072, with 24-bit color, running at 30 frames per second, produces just under 10Gbs of network traffic. Existing tiled displays are being used to show such media, and these high resolution streams are being sent across the country. Because of the data throughput required for 4k video streams, pulling stored video off storage systems in real time is not possible. So current systems providing 4k video streams either use a live source, such as a high-definition camera, or use lossy compression to store the video and transmit it using 1Gb networks. Compression requires specialized high performing equipment on the receiving end and can introduce artifacts in the appearance of the data. We propose the construction of a system to stream stored media (either recorded video or rendered graphics) at full non-compressed resolution to tiled displays.
TJ's efforts are primarily focused on the design and creation of innovative learning spaces of the future. By leveraging the power and flexibility of emerging computer graphics techniques and network computing, a day is envisioned where traditional constraints between time/space and viewer/viewed dissolve within the boundaries of persistent, distributed, real-time, presentational spaces. Important areas of research and investigation include mixed-reality learning space systems, development of sign-engine theatres, web3D, serious games, and real-time motion capture.
Dr. Jeffery Holland, Department of Entomology, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
David Foldes, Computer Graphics Technology & Envision Center, Purdue University
Matt Brisbin, Computer Graphics Technology & Envision Center, Purdue University
Funded by an Envision Center Seed Grant
Participants use the Envision Center's FLEX to immerse themselves in the modeled environment which includes realistic environmental settings and mobile organisms. This simulation experience allows students to see multi-dimensional interactions in real-time, giving them a better understanding of the underlying principles. The simulation will be controlled by parameters set by the participants from within the simulation using a personal digital assistant (PDA). The participants will be able to change their 'position' and hence their perspective within the simulation as it is running. The dynamic nature of the simulation will intuitively convey the complex and dynamic nature of ecological systems and populations. The first use of the Immersive Ecological Experience will be a module that will explore the Equilibrium Theory of Island Biogeography. This module is currently under development, and will be used to teach a class in Biodiversity ENTM 320 http://www.entm.purdue.edu/landscapeecology/teaching.html in the spring semester of 2007.
Dr. Jim Caruthers, Chemical Engineering, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
Steve Dunlop, Envision Center, Purdue University
Leif Delgass, Computer Graphics Technology & Envision Center, Purdue University
David Whittinghill, Computer Graphics Technology & Envision Center, Purdue University
Honggang Wang, Envision Center, Purdue University
Funded by a Department of Energy grant
Our project is an immersive scientific visualization and visual analytics application being developed with the School of Chemical Engineering as part of the Center for Catalyst Design. The application utilizes volume rendering, 3D plotting and tables to visualize molecular structures, quantum chemical computations, statistical data and experimental data stored in a central database. The system scales from a workstation to a high resolution cluster-driven tiled display and can utilize input from keyboard and mouse, joystick, or six degree-of-freedom tracked devices. Currently, we are reviewing feedback and data from a preliminary usability study which has been conducted to improve the user interface of the system. Future work will include additional visualization tools for multivariate data as well as volume rendering of reaction simulations.
Simulated Bio-terror Crises Communication Training Module
Dr. Mohan Dutta-Bergman
Dr. Krishna Madhavan, Rosen Center for Advanced Computing, Purdue University
Dr. Laura Arns, Envision Center, Purdue University
Ed Carpenter, Computer Graphics Technology & Envision Center, Purdue University
Induk Kim, Communication Department, Purdue University
Funded by an Envision Center Seed Grant
The goal of this project is to address various challenges in bio-terror crises communication by developing an innovative crisis communication training module for public relations students. We try to achieve this goal by attending to two main factors: (a) keen awareness of important theories in crises communication response, and (b) significant ¡°hands-on¡± training in real-time bio-terror communication handling techniques. The project uses a FLEX based VR training application, with animated avatars that present students with information about a crisis situation. The students select a course of action based on the information provided, and their choices are evaluated by the program based on the circumstances of the crisis.
Carol Cunningham, Visual and Performing Arts, Purdue University
Steve Dunlop, Envision Center, Purdue University
Joe Humbert, Computer Graphics Technology & Envision Center, Purdue University
An Envision Center Project
This semester this Envision Discoverers are continuing their work with VPA to create an environment for choreographers to visual design their dance pieces. Steve Dunlop in collaboration with Carol Cunningham-Sigman have come up with this idea and felt that it would be a good project for the discoverers. The Envision Discoverers started this project last semester and by the end of the semester we had a 30sec demo for the VPA on what the motion would look like. Andrew Hepp, Ed Leisio, and Zack Clevenger all worked on the Project last semester under Joe Humbert. This semester Ed Leisio and Zack Clevenger have returned along with Mica Bojrad to continue working on the project. To date we have recorded well over 120 individual dance movements covered Jazz, hip hop, and ballet. In addition, we have cleaned up and mapped to characters for final rendering over 20 dance movements. We look forward to the completion of this exciting and innovative project.
Dr. Edward Coyle, ECE and Center for Wireless Systems and Applications, Purdue University
Dr. James Krogmeier, ECE and Center for Wireless Systems and Applications, Purdue University
Dr. Gary Bertoline, Envision Center, Purdue University
Steve Dunlop, Envision Center, Purdue University
Aaron Ault, Center for Wireless Systems and Applications, Purdue University
Timothy J. Rogers, Computer Graphics Technology & Envision Center, Purdue University
E-Stadium "A Living Lab" is a partnership among ITaP, Purdue's Center for Wireless Systems and Applications, and Intercollegiate Athletics. To facilitate real world learning, Purdue has created the concept of the "living laboratory." The living laboratory uses the "city" of Purdue University as a unique environment for experimentation while serving in its traditional role. The goal of e-Stadium is to provide a practical learning experience for Purdue students in the analysis, architecture, design, and application development for wireless networking technologies. As a result, Boilermaker football fans participating in the project will enjoy an enhanced fan experience while at Ross-Ade Stadium.
Dr. Laura Arns, Envision Center, Purdue University
Jack Moreland, Computer Graphics Technology & Envision Center, Purdue University
An Envision Center Project
Research aimed at determining which variables in a VE affect time perception.
An initial experiment has already been run and determined that navigation speed seems to have a correlation with time perception. The faster a user moves while in a VE, the faster times seems to progress. Users in this experiment were given a reference time (5 seconds) signified by a start and stop beep. They were then asked to reproduce this amount of time by pressing a button once to start and again to stop. This was done while the user was moving at a slow speed (approx 5mph) and a fast speed (approx 100mph). When moving at fast speeds users reproduced times approx 15% shorter than when moving at slow speeds. Continued research involves stripping out confounding variables and reproducing the test on a wide spectrum of speeds. The goal is to produce a graph that will show how much time a user will perceive to have passed when navigating at a given speed.
