Browse Topic: Cameras
In order to reduce traffic accidents caused by cars straying from lanes, a lane line recognition and deviation warning system based on machine vision is designed. It mainly includes image preprocessing, lane line detection, and the design of a deviation warning model. “In this study, an ROS-based intelligent vehicle-mounted camera is adopted for road image collection. To reduce the computational load of data processing while guaranteeing the algorithm’s accuracy and reliability, grayscale conversion and region of interest (ROI) extraction are implemented to finish the image preprocessing stage. Additionally, a fusion strategy of global and local thresholds is introduced to enhance both the operational speed and detection accuracy of the algorithm” use the Canny operator for the edge feature extraction; and complete the fitted lane lines with the improved Hough transform. Finally, based on the Kalman filter and camera viewpoint conversion coefficient algorithm, the lane line offset is detected in real time, and the deviation is judged in combination with the monitoring interface. Simulation experiments show that the system is able to effectively recognize the lane line and judge the deviation status under the condition of setting the offset threshold of 70 pixels, which significantly improves the accuracy and real-time performance of the lane deviation warning and provides effective technical support for reducing traffic accidents.
The aging of the population has been a key issue worldwide, with mobility and fall of the elderly an important problem to be solved. In this paper, we propose an elderly mobility assist system based on the intelligent power-assisted device consisting of an assistive cane and an intelligent companion. It has the functions of standing support after falling, daily support and on-site rest. The assistive cane adopts a two-stage expansion mechanism of crank and slider structure, which forms a stable triangular support after unfolding, so that the patient can stand safely. The intelligent companion platform is driven by drive wheels, equipped with pushrod motors and vacuum suction devices, it can automatically approach the user and form an stable support column when the cane is in the out-of reach range; the control system is designed by combining microcontroller, camera object recognition, wristband remote control, to realize automatic steering and autonomous navigation at differential speed. The overall design satisfies the requirements of safety and strength through mechanical verification and stress analysis. The proposed system can help the elderly people to recover from falls better and enhance their independence and safety in their daily walks.
Ultrasonic welding (UW) provides a rapid and efficient method for joining composite components by inducing resin flow through thermally driven diffusion and crystallization at the bonded interface. However, in the absence of a multiphysics modeling framework or a digital twin approach, current practice still depends on extensive trial-and-error testing to determine key welding parameters such as vibration amplitude, weld time, weld pressure, hold time, and downspeed. While in-situ thermal cameras can monitor surface temperatures, the internal temperature at the bonded interface is often significantly higher, introducing the risk of thermal degradation and inconsistent bond quality. To overcome these limitations, GEM developed a high-fidelity multiphysics model to establish a quantitative relationship between process parameters and the evolving temperature field within welded thermoplastic parts. The model integrates coupled mechanical, thermal, and acoustic physics to simulate high-frequency vibrations and static pressure, capture the generation and spatial distribution of heat, and represent the temperature-dependent viscoelastic response that governs bond formation. A validation test matrix was designed by systematically varying weld time and vibration amplitude. Through-thickness temperature distributions were measured using infrared thermal imaging, enabling direct comparison with model predictions. Upon validation, the model was applied for process tailoring, allowing precise control of temperature distribution to achieve target bond strength. This integrated modeling and validation approach demonstrated substantial benefits, including reduced design iterations, accelerated process optimization, and improved quality and performance of welded composite structures.
Edge detection is fundamental for intelligent vehicle applications, directly supporting ADAS functions such as lane detection, obstacle recognition, and scene understanding. The conventional Canny edge detection method exhibits notable shortcomings, especially in color-image processing, adaptive threshold selection, and preserving edge integrity under noisy conditions. In this study, we present an enhanced Canny edge detection framework tailored for ADAS-oriented intelligent vehicle systems, incorporating a quaternion-based weighted averaging scheme for color preservation, adaptive thresholds derived from gradient-amplitude histograms, multiscale edge localization via scale multiplication, and a novel gravitational-field-intensity operator for improved gradient robustness. Moreover, we extend the method to vanishing-point estimation an essential ADAS capability by performing precise intersection calculations combined with clustering techniques such as DBSCAN and RANSAC. Experimental evaluations demonstrate that the proposed algorithm markedly outperforms traditional approaches in edge clarity, localization accuracy, and noise resilience, underscoring its promise for strengthening ADAS perception modules in intelligent vehicles.
Spectral imaging tools — cameras that capture colors beyond the RGB spectrum visible to our eyes — are vital for gleaning information about an object’s material and structural properties. Marrying them with machine learning has provided a powerful pipeline for identifying features in real-world applications including semiconductor fabrication, pollutant tracking, and crop monitoring.
Researchers now say that the best-performing materials in sustainable energy applications — e.g., converting sunlight or waste heat to electricity — often use collective fluctuations of clusters of atoms within a much larger structure; this process is often referred to as “dynamic disorder.”
A team of researchers at Penn State have devised a new, streamlined approach to design metasurfaces, a class of engineered materials that can manipulate light and other forms of electromagnetic radiation with just their structures. This rapid optimization process could help manufacture advanced optical systems like camera lenses, virtual reality headsets, holographic imagers and more, the team said.
Researchers at the University of Tokyo developed a framework to enable decentralized artificial intelligence-based building automation with a focus on privacy. The system enables AI-powered devices like cameras and interfaces to cooperate directly, using a new form of device-to-device communication. In doing so, it eliminates the need for central servers and thus the need for centralized data retention, often seen as a potential security weak point and risk to private data.
The automotive industry is rapidly advancing towards autonomous vehicles, making sensors such as Cameras, LiDAR, and RADAR critical components for ensuring constant information exchange between the vehicle and its surrounding environment. However, these sensors are vulnerable to harsh environmental conditions like rain, dirt, snow, and bird droppings, which can impair their functionality and disrupt accurate vehicle maneuvers. To ensure all sensors operate effectively, dedicated cleaning is implemented, particularly for Level 3 and higher autonomous vehicles. It is important to test sensor cleaning mechanisms across different weather conditions and vehicle operating scenarios to ensure reliability and performance. One crucial aspect of testing is tracking the trajectory of the cleaning fluid to ensure it does not cause self-soiling of vehicles and affects the field of view or visibility zones of other components like the windshield. While wind tunnel tests are valuable, digitalizing this process is vital for making design decisions early in vehicle development. This work presents a digital methodology to test the self-soiling of a vehicle due to the cleaning systems present on vehicle exterior components, e.g. during mud cleaning at different vehicle speeds. The cleaning mechanism involves multiple water nozzles positioned above, below, or on the sides of these components, which spray water jets to remove dirt or mud deposits. The developed numerical method models the motion of cleaning fluid and contaminants after component cleaning. Steady-state aerodynamic simulations using the Finite Volume Method (FVM) are used to capture airflow, while the interaction of air with cleaning fluid and components is analyzed using a Smoothed Particle Hydrodynamics (SPH) solver. Correlations from this study and wind tunnel tests reveal potential optimization opportunities for existing cleaning systems by inspecting surrounding airflows at various vehicle speeds. Preliminary design evaluations indicate a specific vehicle speed range where self-soiling of vehicle components such as the windshield occurs due to mud cleaning. The proposed numerical method provides the capability to evaluate and qualitatively compare vehicle self-soiling due to various cleaning system designs of exterior components, offering valuable insights for optimizing cleaning mechanisms in autonomous vehicles.
As I'm wont to do come December, with work well underway on the first issue of the new year, I like to take stock of upcoming venues for innovative product reveals and thought-provoking presentations on emerging trends and technologies. Come the first week of January, that means CES in Las Vegas. Traditional equipment manufacturers have increasingly used the event to demonstrate to the broader public that they not only deal in metal but also the digital realm. For example, earlier this year at CES, John Deere revealed its second-generation tech stack featuring camera pods, Nvidia Orin purpose-built processors and Deere's VPUs (vision processing units), along with four new autonomous machines including the 9RX 640 tractor for open-field ag operations. The company is exhibiting again this coming year.
Stoneridge displayed its vision for the future of commercial vehicle technology on the SAE COMVEC 2025 exhibit floor. The Innovation Truck showcases the Tier 1 supplier's next-generation vision and driver-assistance technologies designed to enhance driver safety and fleet optimization. Mario Gafencu, product design and evaluation specialist at Stoneridge, gave Truck & Off-Highway Engineering a tech truck walkaround at the event. The first technology Gafencu detailed was the second-generation MirrorEye camera monitor system that's designed to replace the glass mirrors on the sides of a truck.
Planetary and lunar rover exploration missions can encounter environments that do not allow for navigation by typical, stereo camera-based systems. Stereo cameras meet difficulties in areas with low ambient light (even when lit by floodlights), direct sunlight, or washed-out environments. Improved sensors are required for safe and successful rover mobility in harsh conditions. NASA Goddard Space Flight Center has developed a Space Qualified Rover LiDAR (SQRLi) system that will improve rover sensing capabilities in a small, lightweight package. The new SQRLi package is developed to survive the hazardous space environment and provide valuable image data during planetary and lunar rover exploration.
This article suggests a validation methodology for autonomous driving. The goal is to validate front camera sensors in advanced driver-assist systems (ADAS) based on virtually generated scenarios. The outcome is the CARLA-based hardware-in-the-loop (HIL) simulation environment (CHASE). It allows the rapid prototyping and validation of the ADAS software. We tested this general approach on a specific experimental application/setup for a vehicle front camera sensor. The setup results were then proven to be comparable to real-world sensor performance. The CARLA simulation environment was used in tandem with a vehicle CAN bus interface. This introduced a significantly improved realism to user-defined test scenarios and their results. The approach benefits from almost unlimited variability of traffic scenarios and the cost-efficient generation of massive testing data.
Elbit Systems Haifa, Isreal
Waiting for a wound to heal is incredibly frustrating. First, it must clot; then an immune system response is needed; followed by scabbing and scarring — and that’s not even getting into the pain part.
Measuring the volume of harvested material behind the machine can be beneficial for various agricultural operations, such as baling, dropping, material decomposition, cultivation, and seeding. This paper aims to investigate and determine the volume of material for use in various agricultural operations. This proposed methodology can help to predict the amount of residue available in the field, assess field readiness for the next production cycle, measure residue distribution, determine hay readiness for baling, and evaluate the quantity of hay present in the field, among other applications which would benefit the customer. Efficient post-harvest residue management is essential for sustainable agriculture. This paper presents an Automated Offboard System that leverages Remote Sensing, IoT, Image Processing, and Machine Learning/Deep Learning (ML/DL) to measure the volume of harvested material in real-time. The system integrates onboard cameras and satellite imagery to analyze the field and top layers of residue, correlating this data with elevation maps to compute harvested material volume. This innovation supports operations such as baling, residue decomposition time and thereby contributing to land preparation. This technique offers benefits like reduced operational costs, labor independence, and enhanced soil nutrient planning.
Northwestern engineers have developed a new system for full-body motion capture — and it doesn’t require specialized rooms, expensive equipment, bulky cameras, or an array of sensors. Instead, it requires a simple mobile device.
Researchers have developed a prototype imaging system that could significantly improve doctors’ ability to detect cancerous tissue during endoscopic procedures. This approach combines light-emitting diodes (LEDs) with hyperspectral imaging technology to create detailed maps of tissue properties that are invisible to conventional endoscopic cameras.
In today’s digital age, the use of “Internet-of-Things” devices (embedded with software and sensors) has become widespread. These devices include wireless equipment, autonomous machinery, wearable sensors, and security systems. Because of their intricate structures and properties there is a need to scrutinize them closely to assess their safety and utility and rule out any potential defects. But, at the same time, damage to the device during inspection must be avoided.
Image sensors built into every smartphone and digital camera, distinguish colors like the human eye. In our retinas, individual cone cells recognize red, green and blue (RGB). In image sensors, individual pixels absorb the corresponding wavelengths and convert them into electrical signals.
Engineers have developed a smart capsule called PillTrek that can measure pH, temperature, and a variety of different biomarkers. It incorporates simple, inexpensive sensors into a miniature wireless electrochemical workstation that relies on low-power electronics. PillTrek measures 7 mm in diameter and 25 mm in length, making it smaller than commercially available capsule cameras used for endoscopy but capable of executing a range of electrochemical measurements.
The U-Shift IV represents the latest evolution in modular urban mobility solutions, offering significant advancements over its predecessors. This innovative vehicle concept introduces a distinct separation between the drive module, known as the driveboard, and the transport capsules. The driveboard contains all the necessary components for autonomous driving, allowing it to operate independently. This separation not only enables versatile applications - such as easily swapping capsules for passenger or goods transportation - but also significantly improves the utilization of the driveboard. By allowing a single driveboard to be paired with different capsules, operational efficiency is maximized, enabling continuous deployment of driveboards while the individual capsules are in use. The primary focus of U-Shift IV was to obtain a permit for operating at the Federal Garden Show 2023. To achieve this goal, we built the vehicle around the specific requirements for semi-public road operations which includes narrow streets and pedestrians. This involved integrating necessary modifications across multiple domains, including the e/e-architecture, sensor setup, software stack, and even the design of the driveboard and capsule. By utilizing systematic methods to address regulatory and safety challenges, we ensured that the vehicle met the standards required for autonomous driving in semi-public environments. In this paper, we explore the methodologies employed to achieve regulatory compliance, focusing on sensor integration, software- and e/e-architecture. We discuss our multi-modal sensor setup, which combines camera, lidar and radar to archive redundancy and enhanced environmental perception. Additionally, we provide an overview of our software architecture, emphasizing its role in ensuring safe driving functions and enabling autonomous operations.
With 2D cameras and space robotics algorithms, astronautics engineers at Stanford have created a navigation system able to manage multiple satellites using visual data only. They recently tested it in space for the first time. Stanford University, Stanford, CA Someday, instead of large, expensive individual space satellites, teams of smaller satellites - known by scientists as a “swarm” - will work in collaboration, enabling greater accuracy, agility, and autonomy. Among the scientists working to make these teams a reality are researchers at Stanford University's Space Rendezvous Lab, who recently completed the first-ever in-orbit test of a prototype system able to navigate a swarm of satellites using only visual information shared through a wireless network. “It's a milestone paper and the culmination of 11 years of effort by my lab, which was founded with this goal of surpassing the current state of the art and practice in distributed autonomy in space,” said Simone D'Amico, associate professor of aeronautics and astronautics and senior author of the study. “Starling is the first demonstration ever made of an autonomous swarm of satellites.”
In October 2024, Kongsberg NanoAvionics discovered damage to their MP42 satellite, and used the discovery as an opportunity to raise awareness on the need to reduce space debris generated by satellites. Kongsberg NanoAvionics, Vilnius, Lithuania Our MP42 satellite, which launched into low Earth orbit (LEO) two and a half years ago aboard the SpaceX Transporter-4 mission, recently took an unexpected hit from a small piece of space debris or micrometeoroid. The impact created a 6 mm hole, roughly the size of a chickpea, in one of its solar panels. Despite this damage, the satellite continued performing its mission without interruption, and we only discovered the impact thanks to an image taken by its onboard selfie camera in October of 2024. It is challenging to pinpoint exactly when the impact occurred because MP42's last selfie was taken a year and a half ago, in April of 2023.
Items per page:
50
1 – 50 of 641