- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi all,
I've been working with the D415 trying to stream multiple cameras into a single unity scene on one computer. The goal is to have multiple RGB Point clouds in a scene which can be independently transformed. Currently I am working with 2, but plan to work with up to 6.
It seems like I should be able to create a pipeline, list or array of devices based on their Serial NO, and stream independently to separate mesh-based point clouds - but I am not sure how I'd go about doing this.
I am rather new to C# , and am more of a designer than a programmer. If anyone has some suggestions or advice on what to try next, I would appreciate it!
What I know:
-Multicam Example app works great, and streams from all cameras. Both plugged into separate USB Controllers.
-Point clouds can be generated by each camera (one at a time) when using the default prefabs / scene. Hardware is undamaged.
-Both cameras are recognized by Windows and are updated to FW 5.9.14.
What I've tried:
-Installing the new Pre-Released 2.14.1 SDK, but the final step to Build the UnityPackage fails each time.
-Using modified C# scripts that declare a new 'realsensedeviceoriginal' class which is NON-STATIC. This has allowed me to stream depth from multiple cameras in Unity, but still no luck with point clouds. I didn't write this code myself, but tried modifiying PointCloudGenerator.cs to work in a similar way with no success.
I'm running W10 64, with a TR 1920x 12-core, 16GB Ram and a 1080TI, which should be plenty powerful for a pair of cameras at low resolutions. I also have SR300 drivers installed from using the Looking Glass 'HoloPlayer One' device, I'm unsure if this would introduce any errors or conflict.
Thanks so much in advance!
Mike
- Tags:
- Cloud Computing
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have both SR300 and D415 drivers on my PC. They do not conflict.
For Windows users, there is an easy workaround for problems with building the DLL files. You can just drag and drop the pre built ones included with the SDK. This method has worked consistently.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi mcdopsa,
Thank you for your interest in the Intel RealSense D415 camera.
The updated instructions for building the Unity wrapper can be found here: https://github.com/IntelRealSense/librealsense/tree/master/wrappers/unity.
The instructions say that building the Intel.RealSense project "will build both the native library and the .NET wrapper and will copy both DLLs to the Unity project Plugins folder."
Regards,
Alexandra
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I'd also like to mention that an unofficial extension for the Unity wrapper in RealSense 2.0 has been published by a developer that adds a range of features, including multi-camera support and RGBD point clouds.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for your help MartyG, this is just what I was after.
Very strange to see the official Intel version is written to explicitly throw an error when using more than one camera. But why? Even though it asks for a device Serial Number, and has pipelines setup for multiple streams, the code specifically tries to make this impossible.
It'd be great to hear from Intel if there is future intention to allow the SDK's script to accept more than one camera, or if there is some other reason to disable multicam from the start. Multicam is an amazing feature of this camera, and would be great to be able to use it with the official SDK.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
A user on the RealSense GitHub forum who wanted to do multicam stream recording tried it out. They said:
**********
I installed the Unofficial extension. It's based on an old wrapper in which the recording was not rightly included. However the package seems really interesting to calibrate multicameras. It solves partly my next issues on my project. But I still wonder how to record multicamera streams at the same time.
**********
The RealSense development team do add to the Unity wrapper when they get the chance. They did a substantive update to it in the 2.14.0 SDK last month, including new samples (such as binding a point cloud prefab to the camera streams and adding processing block capabilities for them).
https://github.com/IntelRealSense/librealsense/tree/master/wrappers/unity/Assets/RealSenseSDK2.0/Scenes/Samples librealsense/wrappers/unity/Assets/RealSenseSDK2.0/Scenes/Samples at master · IntelRealSense/librealsense · GitHub
I do not work for Intel, so I will have to leave it to them to comment on any Unity multicam support plans.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi mcdopsa,
Multicam support for Unity is planned but we cannot give a timeline for the release of this feature.
Regards,
Alexandra
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for your update for mcdopsa, Alexandra.
In the meantime, a workaround edit for recording multiple streams in Unity was published over the weekend.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Are there any news on this? Is the Unity official extension for Unity supporting multicam?
Thanks,
Aniol
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I believe at this time the official SDK supports Multicam in Unity.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Mike,
It sounds like you're on the right track with creating multi-camera point clouds in Unity using the Intel RealSense D415. Here are some insights and suggestions based on your experience:
Challenges with Multi-Camera Point Clouds:
- SDK Build Issues: The pre-release SDK (2.14.1) might have build issues with the Unity package. You can try searching online forums or contacting Intel RealSense support to see if there are known workarounds or solutions for the specific build error you're encountering.
- Custom Script Modifications: While your approach using a non-static realsensedeviceoriginal class seems promising, it might require further development to handle point cloud generation for multiple cameras.
Alternative Approaches:
Official Multi-Camera Streaming Example: The Intel RealSense SDK might offer an official example project for multi-camera streaming. Check the SDK documentation or online resources to see if such an example exists. This might provide a foundation for building your multi-camera point cloud functionality.
Community Resources: Search online forums or communities dedicated to Intel RealSense and Unity development. Other users might have encountered similar challenges and developed solutions for multi-camera point clouds.
Additional Tips:
Isolate SR300 Drivers: If possible, try temporarily uninstalling the SR300 drivers to eliminate any potential conflicts with the D415.
Consider Alternative Point Cloud Generation Approaches: Explore alternative libraries or assets within the Unity Asset Store that might handle multi-camera point cloud generation.
Resources:
- Intel RealSense SDK Documentation: [Link to Intel RealSense SDK Documentation]
- Intel RealSense Forums: [Link to Intel RealSense Forums]
- Unity Asset Store (Point Cloud Assets): [Link to Unity Asset Store Point Cloud Assets] (Search for keywords like "point cloud", "multi-camera", "RealSense")
Bonus: Streamline Your Unity Workflow (Optional):
While you tackle the multi-camera point cloud challenge, if you're looking for ways to streamline your Unity development process in general, we have a collection of Unity templates available at unity templates. These templates can be a great starting point for various game genres and can help you save time on project setup.
I hope this helps, Mike! Feel free to share any progress you make or if you have further questions about multi-camera point clouds in Unity.
![](/skins/images/7B0AB6865064EAE32B30EC9A4E94B48A/responsive_peak/images/icon_anonymous_message.png)
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page