ARKit 2.0 Object Detection

Development Platform & Builds XR Development
, , , ,
1

Hi,

Is there any instruction on how to implement object detection with ARKit 2.0?

I can see that you can create Candidate Object Data asset but it is really not self-explaining:

270987-download.png

Also, there is an option to select Object Scanning for Session Type in AR Settings (Session Config) and link Candidate Object in Candidate Objects array, but that’s it:

270988-screenshot-7.png
270988-screenshot-7.png936×491 34.1 KB

There is no more info on how to work with ARKit 2.0 object scanning.

Am I missing something? Is object detection supported in UE4 (4.21.2)?

2

I have a same question

3

Same question here :\

4

Hi,Mykhaylo! Candidate Objects — just like image detection/tracking needs to know what to look for in a scene, its size, etc. candidate objects need a similar descriptor before the AR session can search for them.Basically its a wrapper around the Object Detection in Arkit 2.0
Check the following article how to setup the object detection in ARKit.

5

Have you had any luck figuring this out? I am working on the same thing and stuck on the same step.

6

I have a kit on the marketplace that includes object detection for IOS devices:

It also comes with a guide.here: Scanning and detecting objects.pdf - Google Drive

Even if you don’t have the kit, the guide should still help give you an idea of the steps involved

Here’s an example: Object Detection in UE4 - YouTube

2 Likes