[ARkit 2.0] 3D Object Detection.Did someone succeed?

In the documentation there are no explanations how to detect 3D objects. Maybe someone has an idea? To find an object, you must first scan it. But the Session Type Object Scanning crash after the start.

Same problem here.

Is this problem also logged as report in the issues section like the crash with image detection? (couldn´t find it there)

Will the object scanning bug also be fixed in 4.21?

Thank you. What was the First Version of UE you Had success with?

Your Marketplace Link gives a 404

I have a kit on the marketplace that includes object detection for IOS devices: Augmented Reality Toolkit in Blueprints - UE Marketplace

It also comes with a guide.here: Scanning and detecting objects.pdf - Google Drive

If you’re not interested in the kit but would like help with object detection here are the steps I used (ARKit only):

  1. Set your session type to “object scanning”
  2. visualise the AR point cloud with debug points so you see what the ARkit is scanning
  3. use the “Get AR candidate object” node to capture the object when scanning it with your device
  4. Save the captured object data to a slot on your device
  5. Use iTunes to access the save file on your device
  6. load the save game from within the blueprint construction script.
  7. Use the save game data to set variables and make the variables “instance editable” (public)
  8. Drop the blueprint into the world, the object data you scanned should now be visible in details panel
  9. Copy the data from the public variables
  10. Create an “ARcandidateObject” by right clicking in the content browser then /misc/data asset
  11. paste all the data in here
  12. add the ARcandidateObject to the AR session config
  13. change the session type to world in the session config
  14. in your AR pawn blueprint add these nodes: event tick - get all ar geometries - for each loop - cast to AR tracked object - get detected object - get friendly name - equals (the friendly name of your object) - branch - (if true…whatever you want to happen when the object is detected)

I’ve fixed the link Augmented Reality Toolkit in Blueprints - UE Marketplace

The earliest version I used is 4.23, I have not tried it on any earlier versions.

thanks I will give it a try. I was on 4.21 or 4.22 when I decided to stop using UE for that because nothing really worked