Browse Topic: Infotainment systems

Items (374)
In today’s global aviation industry, passenger experience is strongly influenced by effective communication. In-flight announcements, often limited to English and a single local language, can create confusion and stress for international travelers who may not be fluent in either. This communication gap not only impacts passenger comfort but also poses potential risks in conveying time-sensitive or safety-critical information. Recent advances in Generative Artificial Intelligence (GenAI), particularly in speech recognition, neural machine translation, and naturalistic text-to-speech, provide a pathway to overcome these challenges. This paper explores the concept of real-time multilingual in-flight announcements delivered in each passenger’s preferred language through connected headphones or personal devices. The proposed system architecture integrates speech-to-text conversion, language translation, and speech synthesis with aircraft infotainment platforms. Potential applications range from pre-generated multilingual safety messages to long-term visions of fully personalized, real-time translations with minimal latency. Benefits include improved inclusivity, accessibility for hearing-impaired passengers, and enhanced brand differentiation for airlines. Challenges such as regulatory certification, translation accuracy, latency constraints, and hardware integration must be addressed. Beyond aerospace, this capability has cross-domain relevance in automotive, railways, and public services, making it a promising area for future customer experience innovations.
Mishra, AshwiniKature, KartikPatil, Ashish
Automotive research landscape currently is driven by emerging technologies such as software-defined vehicles, advanced infotainment systems, and increasingly automated driving functions. This situation calls for a bigger need for efficient, comprehensive, and agile research methods. Traditional methods require significant manual effort, leading to information synthesis and dissemination bottlenecks. After doing a thorough research on how research is carried on in automotive companies, it is inferred that a lot of time is spent on gathering information and integrating it with proprietary knowledge rather than on analysis or synthesis of the information. There are tools and platforms with artificial intelligence (AI) advancement that help with deep research of a particular topic, and there are also tools and platforms that help with synthesis of proprietary information within automotive organizations. But there is a lack of a framework that dynamically integrates the aspect of deep research with the proprietary information within the organization and draws out action items and action plans for the research to be effective and efficient. The agentic AI framework introduces efficient multi-agent orchestration and seamless integration of proprietary automotive data with external research sources, incorporating principles of building effective multi-agent systems, key metrics, validation techniques, impact and also the future potential. Initial validation demonstrates a 50% reduction in research time, a 50% faster time to insight, and much more impact.
Vemuri, Pavan
Crashes involving passenger vehicles increasingly include vehicles equipped with infotainment systems that are unsupported by commercial vehicle system forensics hardware and software. Examiners facing these systems must overcome challenges in acquiring and analyzing user data, requiring an understanding of both digital forensics principles and the proprietary characteristics of the modules. This paper presents a methodology for acquiring data from previously unsupported Lexus infotainment modules, including techniques to bypass CMD42 security locks on SD cards and extract data. Once acquired, the paper outlines methods for analyzing user data through data carving techniques, enabling recovery of information from binary images even when the full file system cannot be reconstructed. Emphasis is placed on maintaining the integrity of the evidence and validating findings through controlled testing. These validation procedures ensure that the recovered information is both accurate and admissible, providing examiners with actionable intelligence relevant to crash reconstruction and related investigations. A detailed case study demonstrates the application of these methods on an exemplary Lexus infotainment module, illustrating the technical process of bypassing security restrictions, recovering user data, and analyzing the information to uncover relevant insights. Key considerations include correlating extracted data, verifying data integrity, and adapting general forensic principles to a previously unexamined platform. By sharing these findings, the paper provides a roadmap for examiners encountering unsupported vehicle systems, offering practical guidance for overcoming security mechanisms, performing advanced data recovery, and validating results through documented testing. Lessons learned from this work contribute to the broader understanding of automotive digital forensics and underscore the importance of innovative approaches when confronting emerging technologies and proprietary storage protections.
Burgess, Shanon
Integrating intelligent and connected technologies in vehicles has significantly enriched the information environment for drivers, aiding them in making comprehensive driving decisions. However, inadequate information display may lead drivers to miss crucial information or increase their cognitive load, thereby affecting driving safety and user experience. It is essential to study drivers’ preferences for in-vehicle information display, the factors influencing these preferences, and to present information through appropriate modalities and carriers. Drawing on 695 valid questionnaire responses, this study investigates drivers’ preferences for recommendatory, explanatory, alerting, and warning information across three display modalities and six display carriers. A multivariate ordered probability model was further developed to examine the influence of user characteristics on these preferences. The results showed that drivers preferred visual cues over auditory ones, with a selection frequency that was 5.253 times higher (p < 0.001). Additionally, auditory cues were preferred 3.265 times more than tactile cues (p < 0.001). In terms of the interface, drivers favored the center console, which was preferred 1.058 times more than dashboard (p < 0.001). Furthermore, the HUD was found to be significantly better than steering wheel vibrations, being preferred 2.899 times more (p < 0.001). The study found that the choice of message type influences user preferences. Warning messages had a visual choice preference that was 1.669% higher than that for alert messages (p = 0.042). Additionally, auditory choices for alert messages were significantly enhanced, being 11.079% higher than regular messages (p < 0.001). User characteristics also played a significant role in these preferences. Women showed a lower preference for visual messages compared to men, with a ratio of 0.62 (p < 0.05). Senior drivers were less likely to choose visual dashboards, with the likelihood decreasing to 0.82 for each age group (p = 0.017). Furthermore, individuals with higher levels of education showed a preference for auditory messages, with the preference increasing to 1.23 for each education stratum (p < 0.05). The findings provide theoretical support for selecting appropriate modalities and carriers in in-vehicle information displays, particularly for tailoring displays to various information types and user groups.
He, GangDiao, KaiLuo, LongfeiXie, BingjunZhong, YixinQi, Jianping
Despite a noticeable turn away from the wall-to-wall automotive tech wizardary that was so prevalent in recent years and towards robots and other forms of “physical AI,” CES 2026 remained a good place for Qualcomm Technologies Inc. to deliver updates to the media on its various mobility-related technologies. Qualcomm invited SAE Media to Las Vegas to learn about the updates and cover other CES news in person.
Blanco, Sebastian
In-vehicle communication among different vehicle electronic controller units (ECU) to run several applications (I.e. to propel the vehicle or In-vehicle Infotainment), CAN (Controller Area Network) is most frequently used. Given the proprietary nature and lack of standardization in CAN configurations, which are often not disclosed by manufacturers, the process of CAN reverse engineering becomes highly complex and cumbersome. Additionally, the scarcity of publicly accessible data on electric vehicles, coupled with the rapid technological advancements in this domain, has resulted in the absence of a standardized and automated methodology for reverse engineering the CAN. This process is further complicated by the diverse CAN configurations implemented by various Original Equipment Manufacturers (OEMs). This paper presents a manual approach to reverse engineer the series CAN configuration of an electric vehicle, considering no vehicle information is available to testing engineers. To execute reverse engineering, the CAN data log is to be taken from the OBD-II port by systematically identifying and mapping the CAN with various ECUs interfaced with that CAN line. Driver actions and continuous data logged from the OBD-II port are cross-referenced with CAN data to determine the byte order of signals and message frames. The signals derived from one vehicle use scenario (driving) are then validated against another scenario (charging) to ensure consistency and accuracy.
Kumar, RohitSahu, HemantPenta, AmarBhatt, Purvish
With the rapid advancement of connected vehicle technologies, infotainment Electronic Control Units (ECUs) have become central to user interaction and connectivity within modern vehicles. However, this enhanced functionality has introduced new vulnerabilities to cyberattacks. This paper explores the application of Artificial Intelligence (AI) in enhancing the cybersecurity framework of infotainment ECUs. The study introduces AI-powered modules for threat detection and response, presents an integrated architecture, and validates performance through simulation using MATLAB, CANoe, and NS-3. This approach addresses real-time intrusion detection, anomaly analysis, and voice command security. Key benefits include zero-day exploit resistance, scalability, and continuous protection via OTA updates. The paper references real-world automotive cyberattack cases such as OTA vulnerability patches, Connected Drive exploits, and Uconnect hack, emphasizing the critical need for AI-enabled proactive cybersecurity frameworks.
More, ShwetaKulkarni, ShraddhaKumar, PriyanshuGhanwat, HemantJoshi, Vivek
With the increasing complexity and connectivity in modern vehicles, cybersecurity has become an indispensable technology. In the era of Software-Defined Vehicles (SDVs) and Ethernet-based architectures, robust authentication between Electronic Control Units (ECUs) is critical to establish a trust. Further, the cloud connected ECUs must perform authentication with backend servers. These authentication requirements often demand multiple certificates to be provisioned within a vehicle, ensuring secure communication between various combinations of ECUs. As a result, a single ECU may end up storing multiple certificates, each serving a specific purpose. This work proposes a method to limit the number of certificates required in a given ECU without compromising security. We introduce a Cross-Intermediate Certificate Authority (Cross-ICA) Trust Architecture, which enables the use of a single certificate per ECU for inter-ECU communication as well as backend server authentication. In this architecture, each ECU is issued a certificate from an Intermediate Certificate Authority (ICA), with all ICAs anchored to a common Root CA. The ICAs are structured based on the nature or domain of the ECU (e.g., infotainment, telematics, ADAS), while maintaining trust through the shared root. During the authentication handshake, the ECU presents its certificate chain. The receiving party (another ECU or backend server) verifies the chain up to the common root, thus establishing mutual trust, even if their certificates originate from different ICAs. The participating ECUs don’t need prior information about certificate chains of each other. This approach reduces certificate storage requirements, simplifies certificate management, and maintains strong security by leveraging a scalable trust model anchored to a unified root. The proposed method is primarily validated in a virtual environment using an OpenSSL implementation. Additionally, the approach is verified on a simulation setup involving two ECU and cloud connectivity, establishing mTLS with certificates issued by cross-signed Intermediate Certificate Authorities (ICAs).
Venugopal, VaisakhGoyal, YogendraRaja J, SolomonRai, AjayRath, Sowjanya
This paper presents a novel Hardware-in-the-Loop (HiL) testing framework for validating panoramic Sunroof systems independent of infotainment module availability. The increasing complexity of modern automotive features—such as rain-sensing auto-close, global closure, and voice-command operation—has rendered traditional vehicle-based validation methods inefficient, resource-intensive, and late in the development cycle. To overcome these challenges, a real-time HiL system was developed using the Real time simulation, integrated with Simulink-based models for simulation, control, and fault injection. Unlike prior approaches that depend on complete vehicle integration, this methodology enables early-stage testing of Sunroof ECU behavior across open, close, tilt, and shade operations, even under multi-source input conflicts and fault conditions. Key innovations include the emulation of real-world conditions such as simultaneous voice and manual commands, sensor faults, and environmental triggers using a software-controlled test environment. The system helps more than 60 automated test cases and makes regression testing easier without hardware reconfiguration, accelerating feedback cycles and enhancing software readiness. The results show that the framework efficiently identifies test case failures and speeds up validation timelines. The simulation model allows reuse for all ECU variants and streamlines test expansion for future functionalities. Simulation contributes a scalable and infotainment-free testing approach that enhances product quality, reduces dependency on physical prototypes, and supports continuous system integration in automotive control system.
Ghanwat, HemantLad, Aniket SuryakantJoshi, VivekMore, Shweta
Nowadays, digital instrument clusters and modern infotainment systems are crucial parts of cars that improve the user experience and offer vital information. It is essential to guarantee the quality and dependability of these systems, particularly in light of safety regulations such as ISO 26262. Nevertheless, current testing approaches frequently depend on manual labor, which is laborious, prone to mistakes, and challenging to scale, particularly in agile development settings. This study presents a two-phase framework that uses machine learning (ML), computer vision (CV), and image processing techniques to automate the testing of infotainment and digital cluster systems. The NVIDIA Jetson Orin Nano Developer Kit and high-resolution cameras are used in Phase 1's open loop testing setup to record visual data from infotainment and instrument cluster displays. Without requiring input from the system being tested, this phase concentrates on both static and dynamic user interface analysis, including screen transitions, animations, and error messages. Among the methods used are optical character recognition (OCR) for on-screen text validation, convolutional neural networks (CNNs) for screen classification, and object detection for user interface verification. Automated anomaly detection and interface behavior evaluation are made easier with this method. Phase 2 suggests integrating a Hardware-in-the-Loop (HIL) simulator to transform the system into a closed-loop testing environment. The vision-based system will assess system responsiveness and end-to-end behavior, while the HIL setup will produce simulated user inputs and vehicle network data (such as CAN, Ethernet). This thorough framework tackles important issues like complex system integration, multimodal interaction testing, and managing cognitive load. In order to support the creation of safer, more user-friendly infotainment and digital cluster systems that are in line with Advanced Driver Assistance Systems (ADAS) standards, it seeks to decrease the amount of manual testing effort, increase test coverage, and improve consistency.
Lad, Rakesh PramodMehrotra, SoumyaMishra, Arvind
Automotive displays have become an essential part of modern vehicles, not just for aesthetics but also for improving safety and user interaction. As cars get smarter, the industry is leaning heavily into advanced display technologies to provide drivers and passengers with clearer, more responsive visuals. Technologies like Active Matrix LCDs (AMLCDs) and AMOLEDs are now common in dashboards, infotainment systems, digital clusters, and even head-up displays. These display types are popular because they offer great brightness, vibrant color, and wide viewing angles — all of which are important in a car, where lighting conditions can change constantly. But to make these displays work effectively, a solid backplane is critical. That’s where technologies like amorphous silicon (a-Si) and low-temperature polysilicon (LTPS) come in. Among these, LTPS has gained popularity due to its ability to support high-resolution, high-refresh-rate screens, thanks to its higher carrier mobility. Still, LTPS isn’t perfect. It struggles with things like threshold voltage (VTH) shifts, uneven brightness, and flickering — issues that can shorten the display’s life and reduce performance over time. Traditionally, a simple pixel circuit called the 2T1C (two thin-film transistors and one capacitor) has been used, but it doesn’t handle voltage shifts very well. As a result, newer and more complex designs have emerged — including 4T1C, 5T2C, 7T2C, and even 9T2C circuits. These advanced pixel circuits add more components to help regulate voltage and current more precisely. Better compensation for VTH variations, improved image uniformity, reduced flicker, and longer display life. This paper takes a closer look at these different pixel circuit designs, especially how they perform in LTPS-based displays for automotive use. We provide a side-by-side comparison that breaks down the pros and cons of each approach. Understanding how these circuits work — and where each one excels — is key to pushing forward the quality and reliability of displays in next-generation vehicles.
Sinha Roy, DebarghyaDuggal, AnanyaSingh, Ujjwal Kumar
In today’s world, automotive interior lighting systems not only need to meet rigorous internal test standards but also need to adapt with the changing customer’s expectation across different vehicle segments. As per technological advancements and consumer demands, these systems have become increasingly advanced and software driven. Traditionally, validation relied on physical integration with vehicle hardware, particularly infotainment system. However, this conventional approach presents several limitations, including dependency on mature hardware and software, challenges in testing and synchronization across multiple lighting modules, and constraints in design validation accuracy. To address these limitations, this paper introduces an innovative approach that employs real-time hardware-in-the-loop (HIL) simulation for virtual lamp testing. This method facilitates autonomous testing, enabling independent validation of interior lighting systems within a controlled virtual environment while eliminating the dependency on physical vehicle. By digitally controlling lighting systems, this approach provides several key advantages, including accelerated testing cycles, early-stage design validation, and integration testing and delivers higher validation accuracy through precise simulation of real-world scenarios. Additionally, the approach establishes an effective closed loop feedback mechanism for faster issue identification, contributing to significant reduction in overall testing time.
Shah, KunalJoshi, Vivek S.Mandloi, Prince
Commercial vehicle operation faces challenges from driver distraction associated with traditional Human-Machine Interfaces (HMIs) and inconsistent network connectivity, particularly in long-haul scenarios. This paper addresses these issues through the development and presentation of an embedded, offline AI-powered voice assistant. The system is designed to reduce driver distraction and enhance operational efficiency by enabling hands-free control of vehicle functions and access to critical information, irrespective of internet availability. The technical approach involves a three-tier architecture comprising an Android-based In-Vehicle Infotainment (IVI) unit for primary user interaction and voice processing, an Android mobile device acting as a communication bridge and processing hub, and a proprietary OBD-II dongle for CAN bus interfacing. Offline speech recognition is achieved using embedded wake word detection and speech-to-intent engines. A user-centered design methodology, informed by a field study with 25 professional truck drivers in Brazil, guided the prioritization of system functionalities. Key findings from this study highlighted strong driver interest in voice interaction for vehicle status monitoring (e.g., fluid levels, fault alerts) and control of essential systems (e.g., lighting, cabin environment). The implemented prototype successfully integrates these prioritized features, demonstrating the viability of offline voice control. Preliminary observations indicate robust wake word and intent recognition accuracy (≥97% based on vendor benchmarks) and acceptable system responsiveness (400-700 ms latency) under typical cabin noise conditions. This work establishes a foundation for safer, more intuitive HMIs in software-defined commercial vehicles, emphasizing the importance of offline capabilities for reliable operation.
De Oliveira Nelson, RafaelDe Almeida, Lucas GomesArantes Levenhagen, Ivan
Modern automotive systems generate a wide range of audio-based signals, such as indicator chimes, turn signals, infotainment system audio, navigation prompts, and warning alerts, to facilitate communication between the vehicle and its occupants. Accurate Classification and transcription of this audio is important for refining driver aid systems, safety features, and infotainment automation. This paper introduces an AI/ML-powered technique for audio classification and transcription in automotive environments. The proposed solution employs a hybrid deep learning architecture that leverages convolutional neural networks (CNNs) and recurrent neural networks (RNNs), trained using labeled audio samples. Moreover, an Automatic Speech Recognition (ASR) model is integrated for transcribing spoken navigation prompts and commands from infotainment systems. The proposed system delivers reliable results in real-time audio classification and transcription, facilitating better automation and validation. Additionally, we highlight the potential applications of this technology for test automation in automotive software validation. This solution is well-suited for application in transportation systems, surveillance and security, accessibility tools for the hearing impaired, smart home assistants, humanoid robots, and others, making it highly versatile across various domains and platforms. This provides a robust foundation for edge-deployable audio intelligence systems. Beyond Off-highway applications, it applies broadly across other domains where contextual audio understanding is essential--such as in edge-based surveillance systems, supportive accessibility technologies, smart home ecosystems, and self-driving robots. By merging distinctive audio features with state-of-the-art speech transcription, this framework establishes the foundation for scalable and deployable edge-AI systems capable of smart auditory perception across embedded platforms.
Singh, ShwethaKamble, AmitMohanty, AnantaKalidas, Sateesh
While electric powertrains are driving 48V adoption, OEMs are realizing that xEV and ICE vehicles can benefit from a shift away from 12-volt architectures. In every corner of the automotive power engineering world, there are discussions and debates over the merits of 48V power networks vs. legacy 12V power networks. The dialogue started over 20 years ago, but now the tone is more serious. It's not a case of everything old is new again, but the result of a growing appetite for more electrical power in vehicles. Today's vehicles - and the coming generations - require more power for their ADAS and other safety systems, infotainment systems and overall passenger comfort systems. To satisfy the growing demand for low-voltage power, it is necessary to boost the capacity of the low-voltage power network by two or three times that of the late 20th century. Delivering power is more efficient at a higher voltage, and today, 48V is the consensus voltage for that higher level.
Green, Greg
In the early days of computers, interfaces were paper printouts or blinking lights, but as the technology matured, the graphical user interface (GUI) quickly became the standard.
The aircraft cabin plays a crucial role in airline differentiation strategies, particularly when introducing novel, data-driven services. These services aim to enhance the passenger experience during the flight and to improve cabin crew efficiency in order to reduce workload and ensure continued growth of airline revenue. Digitalization and extensive exchange of information across the entire aircraft transport system have emerged as key enablers for these services. The development of aircraft and aircraft systems that realize these services is characterized by a multi-level development process. Various development levels are considered to initially identify the functions of an aircraft in the air transport system, refine its systems and break them down into their components until a level of detail is reached that allows the implementation of the component functions. In addition to the high complexity, a major challenge in this development is to ensure traceability and consistency across the various development levels. Consequently, Model-Based Systems Engineering (MBSE) is increasingly applied in aviation to address these challenges. While numerous MBSE frameworks and methodologies exist, they often overlook the specific requirements of aviation’s multi-level development process. Hence, this paper introduces an MBSE framework tailored to the development of novel, data-driven passenger services, along with the corresponding aircraft systems, across multiple development levels. The framework ensures seamless model-based information flow across all levels by providing a development workflow, which encompasses various viewpoints at each development stage and incorporates aviation-specific regulatory and operational considerations. Additionally, given the digitalized nature of these services and the resulting interconnected systems, relevant cybersecurity information is captured within certain viewpoints at each development level, thereby ensuring the development of secure systems.
Blecken, MarvinHintze, HartmutGiertzsch, FabianGod, Ralf
This SAE Edge Research Report explores advancements in next-generation mobility, focusing on digitalized and smart cockpits and cabins. It offers literature review, examining current customer experiences with traditional vehicles and future mobility expectations. Key topics include integrating smart cockpit and cabin technologies, addressing challenges in customer and user experience (UX) in digital environments, and discussing strategies for transitioning from traditional vehicles to electric ones while educating customers. User Experience for Digitalized and Smart Cockpits and Cabins of Next-gen Mobility covers both on- and off-vehicle experiences, analyzing complexities in developing and deploying digital products and services with effective user interfaces. Emphasis is placed on meeting UX requirements, gaining user acceptance, and avoiding trust issues due to poor UX. Additionally, the report concludes with suggestions for improving UX in digital products and services for future mobility, offering a summary of insights and actionable recommendations to enhance the UX in automotive technologies. Understanding the correlation between UX, user acceptance, and market success from a UX, design, and human-factor perspective will assist companies in creating customer-facing next-gen products. Click here to access the full SAE EDGETM Research Report portfolio.
Abdul Hamid, Umar Zakir
SAE TOMORROW TODAY - Matching Buyers & Sellers to Advance SDV Development134971/16/2025
From evolving consumer expectations to changing business models to updates to the car itself, there is no doubt that software is radically transforming the automotive industry--and companies must adapt now or risk being left behind. The rise of smartphones has permanently altered consumer expectations, and software-defined vehicles (SDVs) are expected to provide experiences akin to those found on mobile devices. Preferences for infotainment and safety features through advanced driver-assistance systems (ADAS) are also increasingly central to purchase decisions. In an effort to meet these demands and accelerate the development of SDVs, SDVerse was developed as a B2B sales marketplace for buyers and sellers of automotive software. The matchmaking platform is available to all OEMs, suppliers, and other companies with relevant software offerings and tools. To learn more, we sat down with Prashant Gulati, Chief Executive Officer, to discuss the role of SDVerse in the automotive industry's shift from hardware-centric to software-first and why differentiating through software will become essential as OEMs seek to remain competitive in an evolving industry. We'd love to hear from you. Share your comments, questions and ideas for future topics and guests to podcast@sae.org. Don't forget to take a moment to follow SAE Tomorrow Today--a podcast where we discuss emerging technology and trends in mobility with the leaders, innovators and strategists making it all happen--and give us a review on your preferred podcasting platform. Follow SAE on LinkedIn, Instagram, Facebook, Twitter, and YouTube. Follow host Grayson Brulte on LinkedIn, Twitter, and Instagram.
Hineman, Marcie
In an era where automotive technology is rapidly advancing towards autonomy and connectivity, the significance of Ethernet in ensuring automotive cybersecurity cannot be overstated. As vehicles increasingly rely on high-speed communication networks like Ethernet, the seamless exchange of information between various vehicle components becomes paramount. This paper introduces a pioneering approach to fortifying automotive security through the development of an Ethernet-Based Intrusion Detection System (IDS) tailored for zonal architecture. Ethernet serves as the backbone for critical automotive applications such as advanced driver-assistance systems (ADAS), infotainment systems, and vehicle-to-everything (V2X) communication, necessitating high-bandwidth communication channels to support real-time data transmission. Additionally, the transition from traditional domain-based architectures to zonal architectures underscores Ethernet's role in facilitating efficient communication between different vehicle zones, thereby reducing wiring complexity and enhancing scalability. However, the increasing adoption of Ethernet in automotive networks also brings forth new cybersecurity challenges. Ethernet-based communication introduces vulnerabilities that malicious actors can exploit to compromise vehicle systems' integrity and security. To address these challenges, robust cybersecurity measures are imperative. This paper will introduce various sensors and methods designed to detect intrusions in Ethernet-based automotive architectures. Leveraging insights from the Automotive Open System Architecture (AUTOSAR) specification, innovative IDS models will be developed to monitor and counter threats targeting AUTOSAR diagnostics. These IDS models will utilize advanced detection mechanisms, including signature-based, anomaly-based, and machine-learning techniques, to swiftly identify and neutralize cyber threats in real-time. By seamlessly integrating with AUTOSAR stacks and Ethernet communication protocols, these IDS models will offer heightened security, real-time threat detection, and adaptability to emerging threats. This research represents a significant advancement in automotive cybersecurity, emphasizing the importance of integrating robust security measures into the fabric of automotive technology to ensure the safety and reliability of autonomous and connected vehicles.
Appajosyula, kalyanSaiVitalVamsi
Virtualization features such as digital twins and virtual patching can accelerate development and make commercial vehicles more agile and secure. There is one sure-fire way to secure commercial vehicles from cyber-attacks. “You just remove the connectivity,” quipped Brandon Barry, CEO of Block Harbor Cybersecurity and the moderator of a panel session on “cybersecurity of virtual machines” at the SAE COMVEC 2024 conference in Schaumburg, Illinois. Obviously, that train has left the station - commercial vehicles of all types, including trains, are only becoming more automated and connected, which increases the risks for cyber-attacks. “We have very connected vehicles, so attacks can be posed not just through powertrain solutions but also through telemetry, infotainment systems connected to different applications and services, and also through cloud platforms,” said Trisha Chatterjee, current product support and data specialist for fuel cell and hydrogen technology at Accelera by Cummins.
Gehm, Ryan
In today’s world, Vehicles are no longer mechanically dominated, with increased complexity, features and autonomous driving capabilities, vehicles are getting connected to internal and external environment e.g., V2I(Vehicle-to-Infrastructure), V2V(Vehicle-to-Vehicle), V2C(Vehicle-to-Cloud) and V2X(Vehicle-to-Everything). This has pushed classical automotive system in background and vehicle components are now increasingly dominated by software’s. Now more focus is made on to increase self-decision-making capabilities of automobile and providing more advance, safe and secure solutions e.g., Autonomous driving, E-mobility, and software driven vehicles, due to which vehicle digitization and lots of sensors inside and outside the vehicle are being used, and automobile are becoming intelligent. i.e., intelligent vehicles with advance safe and secure features but all these advancements come with significant threat of cybersecurity risk. Therefore, providing an automobile that is safe and secure through cyber-attack is also got equal importance. In this paper, we will discuss some of the challenges and key application of cybersecurity in the automotive sector. We will also discuss some possible approaches to address these challenges and enhance the security and privacy of automotive systems. Certain Automotive cybersecurity applications include Secure ECU communication, Digital signature generation and verification, Secure V2X, In-vehicle infotainment (IVI) security, Secure key management and storage, Secure remote vehicle access and control, and Secure over-the-air (OTA) updates. The main challenges for all these applications are to maintain confidentiality, integrity, and authenticity of the data, which can be maintained using cryptographic algorithms and key management realized in Hardware Security Module (HSM). The HSM is a specialized Hardware component designed and integrated as a part of advanced microcontroller unit (MCU) architecture, dedicated to implement cryptographic security tasks. HSM provide various solutions for secure boot/authenticated boot, secure communication, secure key storage, certificate management, standard encryption / decryption algorithms, which strengthen the mode of algorithm and implements very robust Secured ECU communication.
Kumar, ArvindGholve, AshishKotalwar, Kedar
Contrary to what you may have heard, Americans are buying more EVs than ever. But they tend to like 'em big. After production delays due to software development issues - a problem that continues to plague automakers from Volkswagen to General Motors - Volvo's EX90 will look to lure families who live for three-row luxury SUVs. Based on a recent media drive in Newport Beach, California, Volvo may still have some work to do. The twin-motor EX90 did impress us with its 510 hp (380 kW), confident handling, leading-edge safety and sparkling high-resolution displays. But a software glitch dinged our test car when a section of its 14.5-inch (37 cm) center screen blanked out. Other journalists reported issues with a phone-based digital key that briefly left one driver stranded when it wouldn't connect with the Volvo. This is another reason I never rely on an automaker's digital key and always ask for a hard backup.
Ulrich, Lawrence
Data privacy questions are particularly timely in the automotive industry as—now more than ever before—vehicles are collecting and sharing data at great speeds and quantities. Though connectivity and vehicle-to-vehicle technologies are perhaps the most obvious, smart city infrastructure, maintenance, and infotainment systems are also relevant in the data privacy law discourse. Facial Recognition Software and Privacy Law in Transportation Technology considers the current legal landscape of privacy law and the unanswered questions that have surfaced in recent years. A survey of the limited recent federal case law and statutory law, as well as examples of comprehensive state data privacy laws, is included. Perhaps most importantly, this report simplifies the balancing act that manufacturers and consumers are performing by complying with data privacy laws, sharing enough data to maximize safety and convenience, and protecting personal information. Click here to access the full SAE EDGETM Research Report portfolio.
Eastman, Brittany
The pace of innovation in automotive and heavy-duty transportation is rapidly accelerating. Manufacturers are harnessing advancements in electrification and electronification, ushering in new levels of safety, comfort, infotainment, connectivity, performance, and sustainability.
As head of software engineering at Volvo Cars, Alwin Bakkenes is involved not just with all of the software and electronics in Volvo's vehicles but also the automaker's automotive cloud, the data center that trains Volvo's algorithms, the connectivity pipeline and software updates as well as interactions with Volvo's autonomous driving software development subsidiary Zenseact and HaleyTek, a joint venture with ECARX to develop Android-based infotainment systems for Volvo and Polestar. This growing digital footprint gives Volvo an array of tools to improve its future vehicles, something Bakkenes made clear when speaking with SAE Media at the 2024 NVIDIA GTC event in San Jose in March. Volvo started working with NVIDIA around eight years ago and first used the NVIDIA DRIVE Orin system-on-a-chip (SoC) technology in the updated XC90 SUV, introduced in 2022. In 2023, Volvo built a new 22,000 sq m (236,806 sq ft) software testing center in Sweden at a cost of around SEK 300 million (U.S. $28.4 million).
Blanco, Sebastian
The next generation of digital cockpits requires modern architectures to be successful and affordable. This paper provides an in-depth view on the future of digital cockpit architectures. The currently emerging architectures are explored with two main points in focus: The key experiences that drive customer expectations and the options to cost-effectively meet those expectations—while keeping the vehicle affordable. Modern architectures rely on middleware services. Well-designed middleware services allow for an efficient and reusable approach across different model lines and market segments. The paper presents this approach. The new architectures also lead to a transformation of the partner ecosystem between original equipment manufacturers (OEMs) and component suppliers. OEMs try to lever this system while maintaining control over their offerings. These changes transform the traditional semiconductor industry as a whole. The reasons for this transformation and why it is necessary to meet the needs of a zonal architecture is examined. The paper finishes with a look at how cloud-based services and content can be incorporated while providing a unique brand experience.
Taylor, Kyle
As a key component of in-vehicle intelligent voice technology, speech enhancement can extract clean speech signals contaminated by environmental noise to improve the perceptual quality and intelligibility of speech. It has extensive applications in the field of intelligent car cabins. Although some end-to-end speech enhancement methods based on time domain have been proposed, there is often limited consideration given to designing model architectures based on the characteristics of the speech signal. In this paper, we propose a new U-Net based speech enhancement framework that utilizes the temporal correlation of speech signals to reconstruct higher-quality and more intelligible clean speech. Firstly, to address the issue of inadequate extraction of multi-scale correlation features from speech signals during feature extraction and reconstruction, a novel dense connection multi-scale feature extraction module based on gated dilated convolution is devised to enhance temporal receptive length and extract diverse scale features effectively. Secondly, in order to tackle the problem of feature loss and harmonic distortion during sampling, a sophisticated pooling-reconstruction fine-grained sampling method based on feature map recombination is proposed. This method aims to minimize information loss during down-sampling while simultaneously enhancing the clarity of reconstructed waveforms during up-sampling. Lastly, leveraging the aforementioned pooling-reconstruction sampling method, we propose a deep supervision approach for multi-scale feature. This approach effective supervision of perception characteristics across different frequency ranges. In order to validate the effectiveness of the proposed framework, experiments were conducted on the Voicebank+Demand dataset. The results show that compared to other advanced algorithms, the proposed model significantly improves metrics such as PESQ, STOI, CSIG, CBAK, and COVL. Even in low SNR environments, the enhanced speech signals exhibit noticeable improvements in quality and intelligibility. This is beneficial for subsequent automotive voice applications.
Zhang, LijunPei, KaikunLi, WenboMeng, DejianHe, Yinzhi
ChatGPT has entered the car. At CES 2024, Volkswagen and technology partner Cerence introduced an update to IDA, VW's in-car voice assistant, so it can now use ChatGPT to expand what's possible using voice commands in vehicles. VW said the ChatGPT bot will be available in Europe in current MEB and MQB evo models from VW Group brands that currently use the IDA voice assistant. That includes some members of the ID family - the ID.7, ID.4, ID.5 and ID.3 - as well as the new Tiguan, Passat and Golf models. VW brands Seat, Škoda, Cupra and VW Commercial Vehicles also will get IDA integration. VW hopes to bring IDA to other markets, including North America, but did not make any timing announcements.
Blanco, Sebastian
CES 2024 offers a busy look at the software-definied-vehicle future. For a technology set to define our automotive future for years to come, it's surprising that not everyone in the industry can agree on what a software-defined vehicle actually is. It's not controversial to say that SDVs need to be able to adjust - or define - some aspect of a vehicle's performance through software. It's the outer limits of how this works that can prove challenging to define.
Blanco, Sebastian
791P2-2 Mark I Aviation Ku-Band and Ka-Band Satellite Communication System, Part 2, Electrical Interfaces and Functional Equipment DescriptionARINC791P2-2 (Current)1/29/2024
This document (ARINC Characteristic 791, Part 2) provides the non-networking interface definition of the Mark I (ARINC 791) and Mark II (ARINC 792) Ku-Band and Ka-Band Satellite Communication (satcom) system intended for passenger entertainment on commercial transport aircraft. ARINC Characteristic 791 Part 1 of this document provides an overview of Ku-band and Ka-band satcom systems. System provisions, including Line Replaceable Unit (LRU) form factors, attachments, cooling, and inter-system wiring, are defined. Signals between the Modem/Modem Manager (Modman) and the Antenna Subsystem are described to permit interchangeability between any Modman and any Antenna Subsystem. ARINC Characteristic 791 Part 2 of this document provides the non-networking interface definition of the satcom system. Any signal crossing into or out of the communication system is documented to ease aircraft integration. Signals within the satcom system, and in particular, between the Modman and the Antenna Subsystem, are described to permit interchangeability between any Modman and any Antenna Subsystem. ARINC Characteristic 791 Part 3 of this document provides the networking interface definition of the satcom system. Any signal crossing into or out of the communication system is documented to ease aircraft integration.
Airlines Electronic Engineering Committee
Vehicle-to-Everything (V2X) communications has the potential to increase the safety and autonomy of automated vehicles in addition to improving reliability, efficiency, infotainment, traffic, road safety, energy consumption, and costs. V2X is enabled by 5G technologies which promise faster connections, lower latency, higher reliability, more capacity and wider coverage. However, research is lacking in determining exactly how V2X can improve the safety, security, and autonomy of automated vehicles and more specifically what are the main V2X requirements. This paper provides a novel framework and structure to introduce V2X as a perception sensor sub-system into ADAS and ADS and to allocate top level target safety requirements to this new modality. To illustrate the novel structure, an example is provided using AD use cases in the context of the five SAE driving automation levels Level 1 through Level 5. The design follows methodologies from standards and regulations such as ISO 26262 (Functional Safety), ISO 21448 (SOTIF), ISO 34502 (Test scenarios for automated driving), UNECE R-157 (Lane keeping assist system) and R-152 (Autonomous emergency braking) are considered. Following the new novel structure, a set of V2X requirements related to the functional safety of an autonomous emergency braking functionality of an automated vehicle are derived. Mapping the V2X requirements to specific 5G technologies such as IEEE 801.11p, C-V2X, and NR-V2X is out of scope of the paper.
Pimentel, Juan
In an increasingly electrified world, there's still a need for 12-volt batteries and a low-voltage electrical architecture in vehicles. Clarios, which provides the low-voltage architecture for around a third of all vehicles in the world, sees room to grow in the electrified future. Connected vehicles, for example, bring new expectations for what a low-voltage system has to provide, including higher electrical loads. This energy is used for OTA updates when the car is not running, for example, or powering larger infotainment screens. SAE Media editor-in-chief Sebastian Blanco spoke with Clarios president and CEO Mark Wallace and Federico Morales-Zimmermann, group vice president and general manager of original equipment, during a roundtable discussion with multiple journalists. The following Q&A from that event has been edited.
Engineers like to know what customers think about a vehicle. Now, drivers of the all-electric Ford F-150 Lightning and Mustang Mach-E can oblige via a new system that channels select customer comments to engineers. F-150 Lightning fullsize pickup truck and Mustang Mach-E SUV owners in the U.S. can pass along opinions via a 45-second voice message after selecting “record feedback” through the settings-general menu on the infotainment touchscreen. “We want to hear the customer's voice. Ford does customer clinics and events, but this is a different way to capture customer feedback,” Donna Dickson, chief engineer of the Ford Mustang Mach-E, said in an interview with SAE Media.
Buchholz, Kami
I know nothing more about artificial intelligence (AI) than what I read and what learned people tell me. I know it's supposed to bring new sophistication to all manner of processes and technologies, including automated driving. So, when a driverless robotaxi operated by GM's Cruise plowed into a road section of freshly poured cement in San Francisco, it raised questions about recently beleaguered Cruise. My mind wandered to AI, which many AV compute “stacks” are touted to leverage in abundance. Driving into wet cement isn't intelligent. Did somebody need to train the vehicle's AV stack specifically to recognize wet cement? If that's how it works, I'd prefer not to bet my life on whether some fairly oddball happenstance (is the term ‘edge case’ not cool anymore?) had been accounted for in that particular version of the AD system's algorithm running that particular day.
Visnic, Bill
More and more applications (apps) are entering vehicles. Customers would like to have in-car apps in their infotainment system, which they already use regularly on their smartphones. Other apps with new functionalities also inspire vehicle customers, but only as long as the customer can utilize them. To ensure customer satisfaction, it is important that these apps work and that failures are found and corrected as quickly as possible. Therefore, in-car apps also implicate requirements for future vehicle diagnostics. This is because current vehicle diagnostic methods are not designed for handling dynamic software failures of apps. Consequently, new diagnostic methods are needed to support the diagnosis of in-car apps. Log data are a central building block in software systems for system health management or troubleshooting. However, there are different types of log data and log environment setups depending on the underlying system or software platform. Depending on that, the creation of log data takes place with different logging approaches, leading to heterogeneous results that complicates the analysis of log data. In order to classify different types of log data, a taxonomy for log data is derived systematically in this paper. This taxonomy is deduced from identified challenges and heterogeneity regarding logging and log data. Furthermore, the taxonomy is applied to evaluate four logging frameworks for vehicle diagnostics based on three software platforms that are commonly used to operate in-car apps within vehicles: Android, AUTOSAR Adaptive, and Java Standard Edition (SE). As these platforms generate different types of log data, this leads to determining and compare the differences between these frameworks and their commonalities for deployment in vehicles. In addition, the evaluation offers potential starting points for future work regarding the utilization of log data for future vehicle diagnostics and related methods.
Bickelhaupt, SandraHahn, MichaelNuding, NikolaiMorozov, AndreyWeyrich, Michael
Android Automotive OS (AAOS) has been gaining popularity in recent years, with several OEMs across the world already deploying it or planning to in the near future. Besides the benefit of a well-known, customizable and secure operating system for OEMs, AAOS allows third-party app developers to offer their apps on vehicles of several manufacturers at the same time. Currently, there are 55 apps for AAOS that can be categorized as media, navigation or point-of-interest apps. Specifically the latter two categories allow the third-parties to collect certain sensor data directly from the vehicle. Furthermore, the latest version of AAOS also allows the OEM to configure and collect In-Vehicle Infotainment (IVI) and vehicle data (called OEM telemetry). However, increasing connectivity and integration with the in-vehicle network comes at the expense of user privacy. Previous works have shown that vehicular sensor data often contains personally identifiable information (PII). New privacy regulations around the world mandate that the collection and processing of this data has to be clearly communicated with the user of the vehicle who reserves the right to approve or deny. In this paper, the existing AAOS apps are manually analyzed for the user data they collect and share. Of particular interest is the consistency of the declared app permissions with developers’ privacy policies since discrepancies can suggest compliance issues. Our study results show that over 78% of analyzed apps do not mention all dangerous permissions in their privacy policies.
Pese, Mert D.
A modern car is enhancing the driver’s in-vehicle experience through the infotainment system which is a combination of both information and entertainment. The Original Equipment Manufacturers (OEM) are being driven to provide this luxurious experience through the development and adaptation of new technology. In a luxurious car, an infotainment system consists of a high-resolution touchscreen display, smartphone pairing, support for multimedia, installed applications for entertainment, etc. The applications responsible for this experience will exchange the data from the Electronic Control Unit (ECU) to the server and vice versa. If all applications require a unique port for the exchange, then the number of ports will be more which means the number of entry points to exploit the system by an intruder will be increased. For the secure exchange of information, the ECU software consists of a firewall that monitors this exchange and allows only the safe transfer of data to avoid the compromise of the system. A firewall blocks unwanted traffic and data from unauthorized resources. Linux system establishes the firewall through the iptables which has rules to filter ipv4 and ipv6 packets. But these rules are in the root file system which can be accessed directly. If there is no monitoring system for these tables, an intruder can change the rules which leads to an entire system compromise. The proposal is to place the rules in secure storage which is difficult to access by an intruder. This concept makes use of ARM TrustZone technology and requires an implementation of a trusted application running in a secure world through which secure storage can be accessed. In this paper, a comparison of the time taken to enforce the rules between the default process and the proposed process is shown.
Pacharla, Sreedhar ReddyPrasad, Pavan KumarVimlendra, SuryanshVarshney, SauravTiwari, Vishal
Mercedes-Benz developed an in-house computer operating system to join an all-new vehicle platform architecture to enhance automated driving, OTA updates and other features. Mercedes-Benz revealed in late February that it is developing its own computer operating system, dubbed MB.OS, which it said will be standardized across the company's entire model portfolio when deployment begins “mid-decade” in concert with the introduction of the equally new Mercedes Modular Architecture (MMA) vehicle platform. The MB.OS will have full access to all vehicle domains, including infotainment, automated driving, body and comfort, vehicle dynamics and battery charging. Based on a chip-to-cloud architecture, the company asserted MB.OS “is designed to connect the major aspects of the company's value chain, including development, production, omni-channel commerce and services - effectively making it an operating system for the entire Mercedes-Benz business.” The MB.OS architecture is completely updateable to enable rapid product upgrades and is “deliberately open for selected partners,” the company said. It also discreetly added that the new system is planned to “enhance customer lifetime value” by facilitating customer purchases such as content, services and vehicle functionalities. That strategy has been shown by competing automakers to enable certain vehicle features, for example, on a subscription-type basis.
Visnic, Bill
One chip, multiple benefits. That's the claim made by U.S. semiconductor company Qualcomm Technologies Inc. about its new, scalable system-on-a-chip (SoC) product family, called Snapdragon Ride Flex. Unveiled at CES2023 and due to enter the market in early 2024, Snapdragon Flex is the auto industry's first scalable family of SoCs that can run a digital cockpit and ADAS features simultaneously, according to the company. Snapdragon Ride Flex is the latest member of the Snapdragon SoC family. Qualcomm's first-generation Ride Platforms are currently available in commercialized vehicles. Newer generations, which include the Ride Vision stack that can handle ADAS applications, are being tested by Tier 1s. They are expected to arrive on MY2025 vehicles from various OEMs, according to Qualcomm.
Blanco, Sebastian
The smart cockpit has become an irreplaceable element for many new automobile brands, particularly New Energy Vehicles (NEV) of “new forces”. Since the cockpit is a direct interface for the interactions between users and the intelligent and connected functions of the vehicle, any improvements would be easily perceived by users and thus would directly affect user experiences. It would be most important to capture, collect, and understand what users need for a smart cockpit. Users’ online comments on existing smart cockpits contain information on users’ requirements. However, the current user comment text data is too massive, tanglesome, and sparse to process. How to efficiently mine valuable information from these data is non-trivial. This paper focuses on applying the Natural Language Process (NLP) technology for design, development, improvement, and update of a vehicle company’s smart cockpit. By obtaining user comment data from various sources such as eco-system Applications (APP), forums, posts, Questions and Answers(Q&A), customer services, etc., we aim to mine and quantify user demand for the smart cockpit. A deep learning NLP model named Bidirectional Encoder Representations from Transformers (BERT) is developed. In addition, the incremental pre-trained BERT is proposed to predict the mentioned cockpit feature, user’s intention, and emotion from a comment, with one year’s data from our cooperated NEV company for model training. Experiment results showed that our model outperforms the conventional BERT in terms of predictive ability and consumed time. Applications in the cooperated company were discussed.
Lin, ShenheZou, JingkaiZhang, ChaokaiLai, XinjunMao, NingFu, Hui
Items per page:
1 – 50 of 374