Alongside 3D printing and robotics, Augmented and Virtual Reality (AR & VR) are emerging as key Industry 4.0 technologies. Thanks in part to cost reduction and advances in consumer-level equipment, AR & VR applications are becoming well-accepted in product development and manufacturing environments. The novel interaction techniques, including multimodal interfaces and gesture control devices, support traditional manufacturing processes by improving safety, flexibility and precision.
Modelling a facade element using virtual reality (image courtesy UAP)

Virtual Reality (VR) Solutions

Computer-generated 3D environments that respond in real-time to human gestures usually experienced through immersive head-mounted displays. Handheld controllers are used for hand and body tracking and may provide haptic feedback.
In industrial applications, VR can be used as a tool to visualise how different hardware and software can collaborate with human and robot systems, in programming, maintenance and error handling. This is beneficial for understanding spatial relationships in assembly processes, as well as aspects of ergonomics and “viewability” critical for certain processes of product assembly and repair.
VR can also facilitate interactive development and decision making within product design teams. Teams can review the product at scale in a collaborative environment, exploring any limitations in the design or assembly.

Augmented Reality (AR) Solutions

AR is an environment where computer-generated 3D objects, text or graphics are overlayed on the realworld view. In industrial prototyping these techniques can be used to augment a virtual robot or machine into a real-world space.
AR environments allow for safe and precise manipulation of tools in industrial applications– particularly where other methods are not feasible – and can provide context-awareness to increase levels of trust in systems. Recent work is exploring the possibilities of free-form modelling and flow-sculpting. The intent of these developments is to support more natural human gestures in conceptual design. The technology may sidestep the level of skill required to work with CAD technologies, as well as open up the possibility of cross-department workflows within organisations.

Challenges & Considerations

AR & VR systems can still be complex and expensive to set up. In some cases, the virtual environment may be time-consuming to create, increasing human labour and causing it to be an expensive alternative to traditional modelling and prototyping. Despite increased accessibility of commercially available equipment, the interface also has limitations – gesture recognition can be unreliable, the head-mounted hardware uncomfortable, and extended use has been known to cause simulator sickness. Interestingly though, successful simulation in VR is supported by a user’s real-world knowledge of the task. When used as a training tool, VR has had a positive impact in a number of industries, from manufacturing to medical surgery. VR/AR technologies have also been successful in reducing the risk of costs associated with training, particularly in environments that are complex, hazardous, or difficult to access.

Adding Value to Design & Engineering Outcomes

AR & VR can add value to design and engineering outcomes by:

  • Effectively communicating internally across departments, and externally with clients and contractors.
  • Providing more clarity of production requirements and processes for the manufacturing and construction team.
  • Drastically reducing or helping eliminate the amount of documentation which is required for assembly of structures.
  • Establishing more efficient iterative design changes, more effective collaboration across disciplines and departments, and faster design process.
  • AR can also help in Visualising the scale of a structure and its relationship to a site through the use of AR.
  • Assisting in assessing the aesthetic quality of the work.
  • Identifying errors earlier in the production.
  • Evaluating and assessing compliance of Australian standards.
AR & VR Workflow
  • Map out opportunities and potential use-cases with employees
  • Identify a project champion within your organisation to lead the projects

  • Audit current in-house workforce skills

  • Explore potential technology – including options for ongoing technical support and training, some examples:
  • Set aside a physical space (for AR)
  • And provide training and practice time! – See our brief on workforce considerations.
The Future of Manufacturing

With support from the Innovative Manufacturing Cooperative Research Centre (IMCRC), Design Robotics is collaborating to present a range of new fabrication and vision systems solutions. The goal is simple – to design for human intelligence and optimize the relationship between people and machines.
Pushing the limits of industrial robotics is a move to empower people. Navigating the increasing complexity of manufacturing inevitably supports human experience and enhances skills acquisition. At its heart, this approach celebrates the best of what robots and machines can achieve – problem-solving, and the best of what humans can do – social intelligence and contextual understanding.

Resources