[go: up one dir, main page]

Meng et al., 2023 - Google Patents

Synthesizing data for autonomous driving: Multi-agent reinforcement learning meets augmented reality

Meng et al., 2023

Document ID
6669009840815053633
Author
Meng C
Zhang S
Wang H
Gu K
Wang T
Mei J
Publication year
Publication venue
SAE Technical Paper

External Links

Snippet

Synthetic data holds significant potential for improving the efficiency of perception tasks in autonomous driving. This paper proposes a practical data synthesis pipeline that employs multi-agent reinforcement learning (MARL) to automatically generate dynamic traffic …
Continue reading at www.sae.org (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00624—Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20112—Image segmentation details
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36—Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46—Extraction of features or characteristics of the image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/50—Computer-aided design

Similar Documents

Publication Publication Date Title
Chen et al. Geosim: Realistic video simulation via geometry-aware composition for self-driving
Li et al. Read: Large-scale neural scene rendering for autonomous driving
US10643106B2 (en) System and method for procedurally synthesizing datasets of objects of interest for training machine-learning models
Johnson-Roberson et al. Driving in the matrix: Can virtual worlds replace human-generated annotations for real world tasks?
Bruls et al. The right (angled) perspective: Improving the understanding of road scenes using boosted inverse perspective mapping
CN112991537B (en) City scene reconstruction method and device, computer equipment and storage medium
US20230177822A1 (en) Large scene neural view synthesis
Yan et al. Forging vision foundation models for autonomous driving: Challenges, methodologies, and opportunities
CN116012843B (en) Virtual scene data annotation generation method and system
CN117934703A (en) A multi-frame surround view autonomous driving scene simulation and editing method based on three-dimensional Gaussian
He et al. Neural radiance field in autonomous driving: A survey
CN119228984A (en) Three-dimensional scene modeling method, cloud system, storage medium and electronic device
Bu et al. Carla simulated data for rare road object detection
Zhang et al. Resimad: Zero-shot 3d domain transfer for autonomous driving with source reconstruction and target simulation
Wu et al. Emie-map: Large-scale road surface reconstruction based on explicit mesh and implicit encoding
CN116664736A (en) A Road Video Processing Method Based on Cascaded Generative Networks for Style Transfer
CN119339014A (en) Scene reconstruction method, electronic device and product for autonomous driving simulation testing
Yan et al. OASim: An open and adaptive simulator based on neural rendering for autonomous driving
Meng et al. Synthesizing data for autonomous driving: Multi-agent reinforcement learning meets augmented reality
Wu et al. Development of a digital twin-based simulation system and a novel synthetic video dataset for enhancing computer vision in construction site safety
Pasios et al. CARLA2Real: a tool for reducing the sim2real gap in CARLA simulator
Ai et al. Pmscenes: A parallel mine dataset for autonomous driving in surface mines
Yao et al. Road extraction from point cloud data with transfer learning
Huo et al. Semantic segmentation and scene reconstruction for traffic simulation using CNN
Chiciudean et al. Static Mesh Enrichment with Dynamic Entities for Training Sets Generation