- ARToolKit is an open-source computer tracking library for creation of strong augmented reality applications that overlay virtual imagery on the real world. Currently, it is maintained as an open-source project hosted on GitHub. ARToolKit is a very widely used AR tracking library with over 160,000 downloads on its last public release in 2004.
- ARToolKit MMD tutorial virtual 3D Good morning all my friend. Pagi ini saya pengen bagi-bagi informasi mengenai cara membuat sebuah vitual 3d di dalam komputer. Tapi dengan latar kamar kita. Dengan bantuan camera untuk menangkap objek background yang kita inginkan dan selanjutnya di dalam komputer akan dilakukan virtualisasikan ke dalam 3d.
The libary builds two WebAssembly artifacts during the build process. These are build/artoolkitwasm.js and build/artoolkitwasm.wasm. To use those, include the artoolkitwasm.js into your html page and define var artoolkitwasmurl = '/artoolkitwasm.wasm'; before loading the artoolkitwasm.js file, like this.
HoloLens is fascinating in terms of holographic display and in-room localization, but the capability of the front-facing camera (locatable camera) is not fully utilized for potential augmented reality applications.
ARToolKit
Since ARToolKit has served AR/VR for more than 10 years, and it is open-source, it would be nice to have it running on HoloLens. The obstacles towards this goal are quite clear as well:
- Universal Windows has a whole different set of tools and run-time libraries. The dependencies of existing ARToolKit does not exist on UWP, such as pthreads, video libraries, opencv.
- ARToolKit is written in native C/C++ code, and an additional wrapper is needed for development on Unity, which is recommended for HoloLens. (If you are not good at Direct3D, and Windows App)
Luckily, after spending some time on this, I successfully get some pieces of code written, and actually make ARToolKit runs on HoloLens.
The repository is called HoloLensARToolKit on Github.
Demos
The following videos and screenshots are taken with HoloLensARToolKit v0.1.
Samples of HoloLensARToolKit
There are three samples of HoloLensARToolKit, each representing a certain kind of marker that is supported: single marker, cube marker and multi marker.
Minion on the Cube
This video is taken on HoloLens Device Portal, also known as Mixed Reality Capture. You might have noticed that there is still some lag between the video that is captured and update in the rendering.
More Screenshots
- Single Marker
- Cube Marker
- Multi Marker
Finally
Artoolkit
You can access more articles describing the implementation details of HoloLensARToolKit in my blog, simply clicking on the tag:
hololens-artoolkit
.With ARToolKit integrated with HoloLens, many more augmented reality applications are possible. If you are AR/VR developer, you must see what I mean here.
Thanks for reading.
Related Posts
Good morning all my friend... pagi ini saya pengen bagi-bagi informasi mengenai cara membuat sebuah vitual 3d di dalam komputer. tapi dengan latar kamar kita. Dengan bantuan camera untuk menangkap objek background yang kita inginkan dan selanjutnya di dalam komputer akan dilakukan virtualisasikan ke dalam 3d. Jadi seolah-olah sebuah objek akan muncul di kamar kita tetapi hanya ada di dalam komputer. Oke kita lanjut aka ke tutorialnya aja!ARToolKit adalahprogram yang digunakanuntuk menampilkanmodel ataugambar padavideo webcamdengan mendeteksipenanda(teknologiyang sama:pengenalan wajah).Dengan menghitungbagaimana gambaran menandai dideformasi, program akantahu bagaimanapenandaberorientasi padakehidupan nyata.Menggunakan informasi tersebut, program akan memasukkanmodel 3Ddengan orientasilangsung kevideo menggunakanpenandasebagai titikpusat.
Sejak di buatnya MikuMikuDance,adalah perangkat lunak yang bebas dan bagus dalam pemodelan3D, dapatdigunakan untuk memasukkanmodel3d, datagerak,dan datafile gelombangdisimpan dalamfilebiasa .pmmdiaugmented reality..
Artoolkit Tutorial
TUTORIAL
- download MikuMikuDance (mine is directx9 version) from [link]
- to download ARToolkit_MMD, first go to [link]
- go to this link [link] Click the obvious button, then on the next screen, click the one that says in english 'download now'
- extract the files.
- open the ARToolkit/Data folder, then print out the .pdf named pattSample1 on a piece of paper. for best results, you want to attach it to a hard surface.
- back in computerland, open the ARToolkit folder, open up the .ini file named setting.
- change the #MMDDataFolderName to where you extracted your MikuMikuDance Data folder.
- change the PMMFileName to the path where the .pmm file you want to use is located
- you can change the scale to get a larger or smaller scaled model.
- save and exit the .ini file.
- run ARToolkit_MMD.exe
- if you have a 64 bit computer, it should be screwing up saying : msvcp71 is missing. If so, copy and paste the msvcp71 and msvcr71 .dll files in the ARToolkit folder into Windows SysWOW64 folder (not system 32). run ARToolkit_MMD.exe to confirm that its fixed.
- a windows blackscreen appears with a window named 'Property Sheet Properties.
- Frame rate should be as high as you can, check the flip horizontal if youre using a laptop webcam, uncheck if you somehow have your webcam attached to your head. color space, i dont really care. Output size... 640 x 480 have not been giving me problems. larger than that tends to lagg. The default 640 x 400 somehow messes some stuff up a bit
- if you run into an error, it means some models arent loading up or you didnt change the path earlier properly. if so, open MikuMikuDance, open up that .pmm file and just delete the models it cant load.
- if you can run it, a webcam output now appears.
- bring your printed pattern into full view of the webcam window. The whole pattern should be visible.
- the program detects a transformation of the pattern 'matrix' to calculate a viewing orientation.
- the files in the .pmm file should appear, but not move just yet.
- these buttons on your keyboard have specific functions: a - toggles opacity of the AR model. s - begins/pauses the dance routine. r - resets the dance routine
- feel free to move the marker to different orientations to get different views of the whole thing.
- if your .pmm file has a .wav sound file loaded, this version will play the .wav file as well, provided that its title is in a simple form (no jap, no special characters. A pure english title works best.
- to play other .pmm files, you need to open the .ini file and change the path to where the new .pmm file you want to load is loaded.
Artoolkit Tutorial
Artoolkit Tutorial For Beginners
extra info:Jikawebcammengalami kesulitanpenginderaanpenandakarenapenanda tidak terlalu 'hitam', maka bukafilesetting.ini, dan cari kalimat yangbernama MarkerGrayScaleThreshold. Aturke nilaitinggi(255jumlah maksimum) akan membuatpenandaAndaterdeteksibahkan ketikamerekatidak munculsebagai 'hitam'seperti yang seharusnya.
jikalingkungan sekelilingnyaterlaluhitam, makapengaturannomor kenilai yang lebih rendahakan membantu mendeteksipenandadalam kondisi cahayarendah.
Pengaturan standaradalah128.