Browse Topic: Human machine interface (HMI)
ABSTRACT This paper proposes that within the Land domain, there is not only a need to define an approach to open architectures, but also to mandate their use, in order to provide an agile framework for our fighting forces going forward. The paper sets out to explain such an approach; that taken by UK MOD and industry to produce the Generic Vehicle Architecture (GVA) defense standard. It will discuss how the GVA standard was formed, how it is currently being used and how it contributes to the wider MOD initiative for Open Systems Architecture for the Land domain. Finally the paper considers how the UK GVA relates to the US Victory standard and how interoperability may be achieved
ABSTRACT Currently, fielded ground robotic platforms are controlled by a human operator via constant, direct input from a controller. This approach requires constant attention on the part of the operator, decreasing situational awareness (SA). In scenarios where the robotic asset is non-line-of-sight (non-LOS), the operator must monitor visual feedback, which is typically in the form of a video feed and/or visualization. With the increasing use of personal radios, smart devices/wearable computers, and network connectivity by individual warfighters, the need for an unobtrusive means of robotic control and feedback is becoming more necessary. A proposed intuitive robotic operator control (IROC) involving a heads up display (HUD), instrumented gesture recognition glove, and ground robotic asset is described in this paper. Under the direction of the Marine Corps Warfighting Laboratory (MCWL) Futures Directorate, AnthroTronix, Inc. (ATinc) is implementing the described integration for
ABSTRACT Research is currently underway to improve controllability of high degree-of-freedom manipulators under a Phase II SBIR contract sponsored by the U.S. Army Tank Automotive Research, Development, and Engineering Center (TARDEC). As part of this program, the authors have created new control methods as well as adapting tool changing technology onto a dexterous arm to look at controllability of various manipulator functions. In this paper, the authors describe the work completed under this program and describe the findings of this work in terms of how these technologies can be used to extend the capabilities of existing and newly developed robotic manipulators
ABSTRACT Recent advances in neuroscience, signal processing, machine learning, and related technologies have made it possible to reliably detect brain signatures specific to visual target recognition in real time. Utilizing these technologies together has shown an increase in the speed and accuracy of visual target identification over traditional visual scanning techniques. Images containing a target of interest elicit a unique neural signature in the brain (e.g. P300 event-related potential) when detected by the human observer. Computer vision exploits the P300-based signal to identify specific features in the target image that are different from other non-target images. Coupling the brain and computer in this way along with using rapid serial visual presentation (RSVP) of the images enables large image datasets to be accurately interrogated in a short amount of time. Together this technology allows for potential military applications ranging from image triaging for the image analyst
ABSTRACT This paper discusses the design and implementation of an interactive mixed reality cockpit that enhances Soldier-vehicle interaction by providing a 360-degree situational awareness system. The cockpit uses indirect vision, where cameras outside the vehicle provide a video feed of the surroundings to the cockpit. The cockpit also includes a virtual information dashboard that displays real-time information about the vehicle, mission, and crew status. The visualization of the dashboard is based on past research in information visualization, allowing Soldiers to quickly assess their operational state. The paper presents the results of a usability study on the effectiveness of the mixed reality cockpit, which compared the Vitreous interface, a Soldier-centered mixed reality head-mounted display, with two other interface and display technologies. The study found that the Vitreous UI resulted in better driving performance and better subjective evaluation of the ability to actively
ABSTRACT This paper is a technology update of the continued leveraging of using the newest vehicle diagnostics system, the Smart Wireless Internal Combustion Engine (SWICE) interface as the Mini-VCS (Vehicle Computer System). The objective is to further enhance Conditioned Based Maintenance Plus (CBM+) secure diagnostics, data logging, prognostics and sensor integration to support improvement of the US military ground vehicle fleet’s uptime to enhance operational readiness. Evolving advancements of the SWICE initiative will be presented, including how the SWICE “At Platform” Test System can readily be deployed as a multiple-use Mini-VCS. The application of the Mini-VCS integrates the best practices of diagnostics and prognostics, coupled with specialized sensor integration, into a solution that optimally benefits the military ground vehicle fleet. These benefits include increased readiness and operational availability, reduced maintenance costs, lower repair part inventory levels
ABSTRACT The objective is to develop a human-multiple robot system that is optimized for teams of heterogeneous robots control. A new human-robot system permits to ease the execution of remote tasks. An operator can efficiently control the physical multi-robots using the high level command, Drag-to-Move method, on the virtual interface. The innovative virtual interface has been integrated with Augmented Reality that is able to track the location and sensory information from the video feed of ground and aerial robots in the virtual and real environment. The advanced feature of the virtual interface is guarded teleoperation that can be used to prevent operators from accidently driving multiple robots into walls and other objects
ABSTRACT This paper presents Neya’s efforts in developing autonomous depot assembly and parking behaviors for the Ground Vehicle Systems Center’s (GVSC) Autonomous Ground Re-supply (AGR) program. Convoys are a prime target for the enemy, and therefore GVSC is making efforts to remove the human operators and make them autonomous. However, humans still have to manually drive multiple convoy vehicles to and from their depot parking locations before and after autonomous convoy operations – a time-consuming and laborious process. Neya systems was responsible for the design, development, and testing of the autonomous depot assembly and disassembly behaviors, enabling end-to-end autonomy for convoy operations. Our solution to the problem, including the concept of operations, design, as well as approaches towards testing and validation are described in detail
ABSTRACT The concept of handheld control systems with modular and/or integrated display provides the flexibility of operator use that supports the needs of today’s warfighters. A human machine interface control system that easily integrates with vehicle systems through common architecture and can transition to support dismounted operations provides warfighters with functional mobility they do not have today. With Size, Weight and Power along with reliability, maintainability and availability driving the needs of most platforms for both upgrade and development, moving to convertible (mounted to handheld) and transferrable control systems supports these needs as well as the need for the warfighter to maintain continuous control and command connectivity in uncertain mission conditions
ABSTRACT This paper describes an approach to aid the many military unmanned ground vehicles which are still teleoperated using a wireless Operator Control Unit (OCU). Our approach provides reliable control over long-distance, highly-latent, low-bandwidth communication links. The innovation in our approach allows refinement of the vehicle’s planned trajectory at any point in time along the path. Our approach uses hand-gestures to provide intuitive fast path editing options, avoiding traditional keyboard/mouse inputs which can be cumbersome for this application. Our local reactive planner is used for vehicle safeguarding. Using this approach, we have performed successful teleoperation nearly 1500 miles away over a cellular-based communications channel. We also discuss results from our user-tests which have evaluated our innovative controller approach with more traditional teleoperation over highly-latent communication links
ABSTRACT This research proposes a human-multirobot system with semi-autonomous ground robots and UAV view for contaminant localization tasks. A novel Augmented Reality based operator interface has been developed. The interface uses an over-watch camera view of the robotic environment and allows the operator to direct each robot individually or in groups. It uses an A* path planning algorithm to ensure obstacles are avoided and frees the operator for higher-level tasks. It also displays sensor information from each individual robot directly on the robot in the video view. In addition, a combined sensor view can also be displayed which helps the user pin point source information. The sensors on each robot monitor the contaminant levels and a virtual display of the levels is given to the user and allows him to direct the multiple ground robots towards the hidden target. This paper reviews the user interface and describes several initial usability tests that were performed. This research
ABSTRACT The use and operation of unmanned systems are becoming more commonplace and as missions gain complexity, our warfighters are demanding increasing levels of system functionality. At the same time, decision making is becoming increasingly data driven and operators must process large amounts of data while also controlling unmanned assets. Factors impacting robotic/unmanned asset control include mission task complexity, line-of-sight/non-line-of-sight operations, simultaneous UxV control, and communication bandwidth availability. It is critical that any unmanned system requiring human interaction, is designed as a “human-in-the-loop” system from the beginning to ensure that operator cognitive load is minimized and operator effectiveness is optimized. Best practice human factors engineering in the form of human machine interfaces and user-centered design for robotic/unmanned control systems integrated early in platform concept and design phases can significantly impact platform
ABSTRACT This paper surveys the state of autonomous systems and outlines a novel command and control (C2) paradigm that seeks to accommodate the environmental challenges facing warfighters and their robotic counterparts in the future. New interface techniques will be necessary to reinforce the paradigm that supports the C2 of multiple human-machine teams completing diverse missions as part of the Third Offset Strategy. Realizing this future will require a new approach to teaming and interfaces that fully enable the potential of independent and cooperative decision-making abilities of fully autonomous machines while maximizing the effectiveness of human operators on the battlefield
ABSTRACT The confluence of intra-vehicle networks, Vehicular Integration for (C4ISR) Command, Control Communication, Computers, Intelligence, Surveillance, Reconnaissance/(EW) Electronic Warfare Interoperability (VICTORY) standards and onboard general-purpose processors creates an opportunity to implement Army combat ground vehicle intercommunications (intercom) capability in software. The benefits of such an implementation include 1) SWAP savings, 2) cost savings, 3) simplified path to future upgrades and 4) enabling of potential new capabilities such as voice activated mission command. The VICTORY Standards Support Office (VSSO), working at the direction of its Executive Steering Group (ESG) members (Program Executive Office (PEO) Ground Combat Systems (GCS), PEO Combat Support and Combat Service Support (CS&CSS), PEO Command Control Communications-Tactical (C3T) and PEO Intelligence, Electronic Warfare and Sensors (IEW&S)), has developed and demonstrated a software intercom
ABSTRACT As the number of robotic systems on the battlefield increases, the number of operators grows with it, leading to significant cost burden. Autonomous robots are already capable of task execution with limited supervision, and the capabilities of autonomous robots continue to advance rapidly. Because these autonomous systems have the ability to assist and augment human soldiers, commanders need advanced methods for assigning tasks to the systems, monitoring their status and using them to achieve desirable results. Mission Command for Autonomous Systems (MCAS) aims to enable natural interaction between commanders and their autonomous assets without requiring dedicated operators or significantly increasing the commanders’ cognitive burden. This paper discusses the approach, design and challenges of MCAS and present opportunities for future collaboration with industry and academia
ABSTRACT This presentation will review the ongoing lessons learned from a joint Industry/DoD collaborative program to explore this area over the past 5 years. The discussion will review the effectiveness of integrating multiple new technologies (combined with select COTS elements) to provide a complete solution designed to reduce spares stockpiles, maximize available manpower, reduce maintenance downtime and reduce vehicle lifecycle costs. A number of new and emerging technology case studies involving diagnostic sensors (such as battery health monitors), knowledge management data accessibility, remote support-based Telematics, secure communication, condition-based software algorithms, browser-based user interfaces and web portal data delivery will be presented
ABSTRACT Application of human figure modeling tools and techniques has proven to be a valuable asset in the effort to examine man-machine interface problems through the evaluation of 3D CAD models of workspace designs. Digital human figure modeling has also become a key tool to help ensure that Human Systems Integration (HSI) requirements are met for US Army weapon systems and platforms. However, challenges still exist to the effective application of human figure modeling especially with regard to military platforms. For example, any accommodation analysis of these systems must not only account for the physical dimensions of the target Soldier population but also the specialized mission clothing and equipment such as body armor, hydration packs, extreme cold weather gear and chemical protective equipment to name just a few. Other design aspects such as seating, blast mitigation components, controls and communication equipment are often unique to military platforms and present special
ABSTRACT We have developed techniques for a robot to compute its expected myopic gain in performance from asking its operator specific questions, such as questions about how risky a particular movement action is around pedestrians. Coupled with a model of the operator’s costs for responding to inquiries, these techniques form the core of a new algorithm that iteratively allows the robot to decide what questions are in expectation most valuable to ask the operator and whether their value justifies potentially interrupting the operator. We have performed experiments in simple simulated robotic domains that illustrate the effectiveness of our approach
ABSTRACT As U.S. Army leadership continues to invest in novel technological systems to give warfighters a decisive edge for mounted and dismounted operations, the Integrated Visual Augmentation System (IVAS) and other similar systems are in the spotlight. Continuing to put capable systems that integrate fighting, rehearsing, and training operations into the hands of warfighters will be a key delineator for the future force to achieve and maintain overmatch in an all-domain operational environment populated by near-peer threats. The utility and effectiveness of these new systems will depend on the degree to which the capabilities and limitations of humans are considered in context during development and testing. This manuscript will survey how formal and informal Human Systems Integration planning can positively impact system development and will describe a Helmet Mounted Display (HMD) case study
ABSTRACT The concept of handheld control systems with modular and/or integrated display provides the flexibility of operator use that supports the needs of today’s warfighters. A human machine interface control system that easily integrates with vehicle systems through common architecture and can transition to support dismounted operations provides warfighters with functional mobility they do not have today. With Size, Weight and Power along with reliability, maintainability and availability driving the needs of most platforms for both upgrade and development, moving to convertible (mounted to handheld) and transferrable control systems supports these needs as well as the need for the warfighter to maintain continuous control and command connectivity in uncertain mission conditions
ABSTRACT The U.S. Army Combat Capabilities Development Command (DEVCOM) Ground Vehicle Systems Center (GVSC) has been developing next generation crew stations over the last several decades. In this paper, the problem space that impacts design development and decisions is discussed. This is followed by a historical overview of crewstation development activities that have evolved over the last 30 years, as well as key lessons learned that must be considered for successful ground vehicle Soldier-vehicle interactions. Lastly, the direction and critical technological focus areas are identified to exploit advancements and meet future combat vehicle system needs. Citation: T. Tierney, “A Perspective on GVSC Crewstation Development and Addressing Future Ground Combat Vehicle Needs,” In Proceedings of the Ground Vehicle Systems Engineering and Technology Symposium (GVSETS), NDIA, Novi, MI, Aug. 15-17, 2023
Abstract Converting vehicles from conventional manned operations to unmanned supervised operations has been slow to adoption in many industries due to cost, complexity (requiring more highly skilled personnel) and perceived lower productivity. Indeed, hazardous operations (military, nuclear cleanup, etc.) have seen the most significant implementations of robotics based solely on personnel safety. Starting in 2005, the U.S. Army Corps of Engineers (USACE) has assumed a leading role in promoting the use of robotics in unexploded ordnance (UXO) range remediation. Although personnel safety is the primary component of the USACE mission, increasing productivity while reducing overall cost is an extremely important driver behind their program. To achieve this goal demands that robotic range clearance equipment be affordable, easy to install on rental equipment, durable and reliable (to minimize down-time), low or no maintenance, and easy to learn / operate by the same individuals who would
ABSTRACT Commercial OEMs are fast realizing the long awaited dream of self-driving trucks and cars. The technology continues to improve with major implications for the Army. In the near tear, the impact may be most profound for military installations. Many believe, however, that the major limiting factor to wide-spread automated vehicle usage will not be technology but the human element. What happens when humans through no choice of their own are compelled to interact with self-driving vehicles? We propose a mixed-methods research study that examines the complex transportation system from both a technical and social perspective. This study will inform environmental controls (rules of the road and infrastructure modifications) and increase understanding of the social dynamics involved with vehicle acceptance. Findings may pave the way for a reduction in the over $400M the Army spends annually on non-tactical vehicles and the technical improvements, grounded in dual-use use cases will be
Crew Station design in the physical realm is complex and expensive due to the cost of fabrication and the time required to reconfigure necessary hardware to conduct studies for human factors and optimization of space claim. However, recent advances in Virtual Reality (VR) and hand tracking technologies have enabled a paradigm shift to the process. The Ground Vehicle System Center has developed an innovative approach using VR technologies to enable a trade space exploration capability which provides crews the ability to place touchscreens and switch panels as desired, then lock them into place to perform a fully recorded simulation of operating the vehicle through a virtual terrain, maneuvering through firing points and engaging moving and static targets during virtual night and day missions with simulated sensor effects for infrared and night vision. Human factors are explored and studied using hand tracking which enables operators to check reach by interacting with virtual components
Today’s intelligent robots can accurately recognize many objects through vision and touch. Tactile information, obtained through sensors, along with machine learning algorithms, enables robots to identify objects previously handled
Semi-automated computational design methods involving physics-based simulation, optimization, machine learning, and generative artificial intelligence (AI) already allow greatly enhanced performance alongside reduced cost in both design and manufacturing. As we progress, developments in user interfaces, AI integration, and automation of workflows will increasingly reduce the human inputs required to achieve this. With this, engineering teams must change their mindset from designing products to specifying requirements, focusing their efforts on testing and analysis to provide accurate specifications. Generative Design in Aerospace and Automotive Structures discusses generative design in its broadest sense, including the challenges and recommendations regarding multi-stage optimizations. Click here to access the full SAE EDGETM Research Report portfolio
Homologation is an important process in vehicle development and aerodynamics a main data contributor. The process is heavily interconnected: Production planning defines the available assemblies. Construction defines their parts and features. Sales defines the assemblies offered in different markets, where Legislation defines the rules applicable to homologation. Control engineers define the behavior of active, aerodynamically relevant components. Wind tunnels are the main test tool for the homologation, accompanied by surface-area measurement systems. Mechanics support these test operations. The prototype management provides test vehicles, while parts come from various production and prototyping sources and are stored and commissioned by logistics. Several phases of this complex process share the same context: Production timelines for assemblies and parts for each chassis-engine package define which drag coefficients or drag coefficient contributions shall be determined. Absolute and
Using electrical impedance tomography (EIT), researchers have developed a system using a flexible tactile sensor for objective evaluation of fine finger movements. Demonstrating high accuracy in classifying diverse pinching motions, with discrimination rates surpassing 90 percent, this innovation holds potential in cognitive development and automated medical research
The lane departure warning (LDW) system is a warning system that alerts drivers if they are drifting (or have drifted) out of their lane or from the roadway. This warning system is designed to reduce the likelihood of crashes resulting from unintentional lane departures (e.g., run-off-road, side collisions, etc.). This system will not take control of the vehicle; it will only let the driver know that he/she needs to steer back into the lane. An LDW is not a lane-change monitor, which addresses intentional lane changes, or a blind spot monitoring system, which warns of other vehicles in adjacent lanes. This informational report applies to original equipment manufacturer and aftermarket LDW systems for light-duty vehicles (gross vehicle weight rating of no more than 8500 pounds) on relatively straight roads with a radius of curvature of 500 m or more and under good weather conditions
Items per page:
50
1 – 50 of 917