Skip to content

AI Technologies

Multimodal AI

Every data source has its strengths and limits. The result becomes reliable when text, images, audio, sensor data, and geodata are interpreted together.

Street scene from the driver's perspective with the roadway highlighted in colour, detected vehicles, and labelled traffic signs, with map sections alongside
Image, labels, and map: several types of information are evaluated together.

Methods and techniques

  • Vision-language models for images and text in context
  • Enrichment with reference knowledge, for example standards data
  • Merging, weighting, and plausibility checking of multiple sources
  • Quality check of the overall result

Typical data

  • Text and document images
  • Photos and videos
  • Audio
  • Sensor data
  • Geodata
  • Structured technical data

Application examples

  • Recognising traffic signs: image section, standard description, and example symbol are evaluated together
  • Understanding documents as objects made up of text, images, characters, and layout

We have been working on the fusion of sensor data since the company was founded. Today we supplement images, radar data, and laser data with texts, symbols, databases, maps, and standards. Sensor fusion becomes multimodal AI.

Example: recognising traffic signs

A traffic sign in a camera image is small, often weathered, partially occluded, or backlit. We combine three paths to recognition:

PathWhat is mergedEffect
Textual fusionSemantic search in a knowledge base with official standards dataThe context is enriched with descriptions
Visual fusionText and image sectionHigher precision through image analysis
Multimodal fusionText, image section, and standardised example symbolsRobust through comparison with the reference image

A vision-language model evaluates the image section together with this context. We distribute the work steps among specialised agents; a quality mechanism checks whether the decision is plausible and sound.

The same principle, different data

Historical documents seem far removed from autonomous mobility. Technologically they are very similar: complex visual structures, texts, characters, layouts, and relationships that only emerge from the whole. That is why we transfer our approach from vehicle perception to documents, geodata, and engineering data.

Further topics

AI Technologies

Vision AI

Image-based and video-based AI, grown out of many years of experience in industrial machine vision.

AI Technologies

Sensor Fusion & Physical AI

Combining information from different physical measurement sources – camera, radar, LiDAR, and other sensors – as the basis for systems that act in the real world.

AI Technologies

Document & Knowledge Intelligence

Making large, heterogeneous bodies of information accessible and turning unstructured information into knowledge models that are usable for the business domain.

Solutions

Document and Knowledge Intelligence

Understanding documents instead of merely reading them: archives, files, and technical documentation become structured knowledge you can query.

Would you like to make AI usable in your company?

Whether a first AI adoption or a complex development task – we discuss the requirements and suitable next steps with you.

Discuss your AI project