24/7 Space News
Invisible tagging system enhances 3D object tracking
BrightMarker is a fabrication method that uses fluorescent filaments to embed easily trackable markers in 3D-printed color objects. Credits:Photos courtesy of the researchers/MIT CSAIL.
Invisible tagging system enhances 3D object tracking
by Alex Shipps for MIT CSAIL
Boston MA (SPX) Aug 15, 2023

Stop me if you've seen this before: a black and white pixelated square in lieu of a physical menu at a restaurant. QR codes are seemingly ubiquitous in everyday life. Whether you see one on a coupon at the grocery store, a flyer on a bulletin board, or the wall at a museum exhibit, each code contains embedded data.

Unfortunately, QR codes in physical spaces are sometimes replaced or tampered with to trick you into giving away your data to unwanted parties - a seemingly harmless set of pixels could lead you to dangerous links and viruses. Researchers from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) have developed another potential option: BrightMarker, an invisible, fluorescent tag hidden in 3D-printed objects, such as a ball, container, gadget case, or gear. The researchers believe their system can enhance motion tracking, virtual reality, and object detection.

To create a BrightMarker, users can download the CSAIL team's software plugin for 3D modeling programs like Blender. After placing the tag within the geometry of their design, they can export it as an STL file for 3D printing. With fluorescent filaments inserted into the printer, users can fabricate an object with a hidden tag, much like an invisible QR code. Users will need to embed their markers into an object before it's fabricated, meaning the tags cannot be added to existing items.

The fluorescent materials enable each tag to emit light at a specific near-infrared wavelength, making them viewable with high contrast in infrared cameras. The researchers designed two attachable hardware setups capable of detecting BrightMarkers: one for smartphones and one for augmented reality (AR) and virtual reality (VR) headsets.

Both have the capacity to view and scan the markers, which resemble glow-in-the-dark QR codes. Surrounding objects could be obscured from view using a longpass filter, another attachable piece that would only spot the fluorescence.

BrightMarkers are imperceptible to the naked eye - and unobtrusive, meaning they don't alter an object's shape, appearance, or function. This makes them tamper-proof while seamlessly embedding metadata into the physical world. By adding a layer of connectivity between data and physical objects, users would have access to a more interactive experience with the world around them.

"In today's rapidly evolving world, where the lines between the real and digital environments continue to blur, there is an ever-increasing demand for robust solutions that seamlessly connect physical objects with their digital counterparts," says MIT CSAIL and Department of Electrical Engineering and Computer Science PhD candidate Mustafa Doga Dogan.

"BrightMarkers serve as gateways to 'ubiquitous metadata' in the physical realm. This term refers to the concept of embedding metadata - descriptive information about the object's identity, origin, function, and more - directly into physical items, akin to an invisible digital signature accompanying each product."

BrightMarkers in action
Their system has shown promise in virtual reality settings. For example, a toy lightsaber with an embedded BrightMarker could be used as an in-game tool to slice through a virtual environment, using the tag-detecting hardware piece. This tool could enable other in-game objects for a more immersive VR experience.

"In a future dominated by the AR and VR paradigm, object recognition, tracking, and traceability is crucial for connecting the physical and digital worlds: BrightMarker is just the beginning," says MIT CSAIL visiting researcher Raul Garcia-Martin, who is doing his PhD at the University Carlos III of Madrid. "BrightMarker's seamless tracking marks the start of this exciting journey into a tech-powered future."

As for motion tracking, BrightMarkers can be implemented into wearables that can precisely follow limb movements. For example, a user could wear a bracelet with an implanted BrightMarker, enabling a piece of detection hardware to digitize the user's motion. If a game designer wanted to develop an authentic first-person experience, they could model their characters' hands after the precise tracking each marker provides. The system can support users with impairments and different limb sizes, too, bridging the gap between digital and physical experiences for a wide user base.

BrightMarkers could also be tracked across the supply chain. Manufacturers on-site could scan the tags at different locations to grab metadata about the product's origin and movements. Likewise, consumers could check a product's digital signature to verify ethical sourcing and recycling information, similar to the European Union's proposed Digital Product Passports.

Another potential application: night vision monitoring in home security cameras. If a user wanted to ensure their possessions were safe overnight, a camera could be equipped to watch the objects with hardware designed to trace and notify the owner about any movements. Unlike its off-the-shelf counterparts, this camera wouldn't need to capture the user's whole room, thus preserving their privacy.

Better than InfraredTags and AirTags
Dogan and his team's work may sound familiar: they previously developed InfraredTags, a technology for embedding data on 3D-printed tags within physical objects, which was nominated for a People's Choice Best Demo Award at the 2022 ACM CHI Conference on Human Factors in Computing Systems. While their previous project only worked for black objects, users have multiple color options with BrightMarker. With its fluorescent materials, the tags are configured to emit light at a specific wavelength, making them much easier to isolate and track than InfraredTags, which could only be detected at low contrast due to noise from other wavelengths in the captured environment.

"The fluorescent filaments emit a light that can be robustly filtered using our imaging hardware," says Dogan. "This overcomes the 'blurriness' often associated with traditional embedded unobtrusive markers, and allows for efficient real-time tracking even when objects are in motion."

In comparison to Apple's AirTags, BrightMarkers are low-cost and low-energy. Depending on the application, though, one potential limitation is that the tags cannot be added to objects post hoc currently. Additionally, tracking each tag can be hindered if the user's hand or another item in the room obstructs the camera's view.

As a remedy for potentially enhancing detection, the team recommends combining this technology with magnetic filaments so that the object's magnetic field can also be tracked. The markers' detection performance could also be improved by producing filaments with higher fluorochrome concentrations.

"Immersive technologies require powerful scene understanding capabilities," says Google research scientist Mar Gonzalez-Franco, who was not involved in the work. "Having invisible markers embedded, like the ones from BrightMarker, can simplify the computer vision needs and help devices identify the objects that are interactable and bridge the gap for the users of AR and VR."

Dogan is optimistic about the system's potential to enmesh metadata in our everyday lives. "BrightMarker holds tremendous promise in reshaping our real-life interactions with technology," he notes.

"As this technology continues to evolve, we can envision a world where BrightMarkers become seamlessly integrated into our everyday objects, facilitating effortless interactions between the physical and digital realms. From retail experiences where consumers can access detailed product information in stores to industrial settings, where BrightMarkers streamline supply chain tracking, the possibilities are vast."

Dogan and Garcia-Martin wrote the paper along with MIT CSAIL undergraduate students Patrick Haertel, Jamison O'Keefe, Ahmad Taka, and Akarsh Aurora. Raul Sanchez-Reillo, a professor at University Carlos III of Madrid, and Stefanie Mueller, a CSAIL affiliate and associate professor in the MIT departments of Electrical Engineering and Computer Science and Mechanical Engineering, are also authors. The researchers used fluorescent filaments provided by DIC Corp. They will present their findings at the Association for Computing Machinery's 2023 User Interface Software and Technology Symposium (UIST).

Research Report:"BrightMarker: 3D Printed Fluorescent Markers for Object Tracking"

Related Links
Computer Science and Artificial Intelligence Laboratory (CSAIL)
Space Technology News - Applications and Research

Subscribe Free To Our Daily Newsletters

The following news reports may link to other Space Media Network websites.
DLR harnesses 3D Printing for efficient production of spaceflight components
Berlin, Germany (SPX) Aug 06, 2023
The German Aerospace Center (DLR) is looking into ways to make space propulsion systems more cost-effective and reusable. The emphasis of their investigation lies in the 3D Printing for Low-Cost Space Components (3D-LoCoS) project. This project seeks to enhance the techniques of metal-based additive manufacturing, essentially 3D printing processes. This advancement will allow for the swifter, more budget-friendly production of technology demonstrators for new space components. According to Jan Hau ... read more

Embracing the future we need

Russian cosmonauts perform spacewalk to attach debris shields to space station

Advanced Space selected for two NASA SBIR Phase I Awards

NASA and Axiom Space join forces for fourth private mission in 2024

Impulse Space secures $45M in Series A Funding Round

Rocket Lab inks new deal to launch HASTE mission from Virginia

Boeing says troubled Starliner will be ready to fly crew by March

Hypersonics Capability Center: Northrop Grumman's next step beyond Mach 5

Organic molecules in Martian crater help to reconstruct planet's history

Mars once had wet-dry climate conducive to supporting life: study

InSight study finds Mars is spinning faster

Ingenuity flies again after unscheduled landing

China to launch "Innovation X Scientific Flight" program, applications open worldwide

Scientists reveal blueprint of China's lunar water-ice probe mission

Shenzhou 15 crew share memorable moments from Tiangong Station mission

China's Space Station Opens Doors to Global Scientific Community

ESA's Space Environment Report 2023

US storms, natural disasters push up insurance costs: Swiss Re

Eutelsat and Thaicom to partner for new software-defined satellite over Asia

Astra Space optimizes workforce to support sustainable long-term business plan

De-orbiting PS4 stage in PSLV-C56 Mission

Damage control: WVU researchers aim for the sky to track lethal space debris

Invisible tagging system enhances 3D object tracking

LeoLabs provides tracking support for ESA's historic assisted satellite reentry

The oldest and fastest evolving moss in the world might not survive climate change

Chemical contamination on International Space Station is out of this world

New exoplanet discovery builds better understanding of planet formation

Violent Atmosphere Gives Rare Look at Early Planetary Life

Looking for Light with New Horizons

James Webb Space Telescope sees Jupiter moons in a new light

NASA's Juno Is Getting Ever Closer to Jupiter's Moon Io

SwRI team identifies giant swirling waves at the edge of Jupiter's magnetosphere

Subscribe Free To Our Daily Newsletters


The content herein, unless otherwise known to be public domain, are Copyright 1995-2023 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.