Umbono Wokwenziwa Ngamamojula e-Arduino kanye Nezindleko Eziphansi

  • Setha amamojula ekhamera athengekayo ukuze uthole umbono womshini kumaphrojekthi we-Arduino.
  • Ilungiselela izingxenyekazi zekhompuyutha nesofthiwe ukuphatha idatha yesithombe kahle.
  • Sebenzisa amathuluzi afana ne-TensorFlow Lite Micro kumaphrojekthi wokufunda wemishini athuthukile.

umbono wokufakelwa

Ukubona ngekhompyutha kuyinkambu ekhula njalo, futhi ngenxa yamathuluzi afana ne-Arduino namamojula wekhamera athengekayo, manje sekungenzeka ukuqalisa amaphrojekthi aqanjwe kabusha ngaphandle kokutshala izizumbulu zemali. Lesi sihloko sizohlola amathuba okusebenza nawo umbono wokufakelwa kumaphrojekthi we-Arduino usebenzisa amamojula abiza kancane, ukusebenzisa amalabhulali nezindlela zokuthuthukisa imiphumela.

Uma ungumuntu othanda ubuchwepheshe noma umthuthukisi ofuna izindlela ezintsha zokuhlola, hlanganisa a ikhamera kuphrojekthi yakho ye-Arduino kuvula umhlaba wamathuba. Lapha uzothola umhlahlandlela onemininingwane ehlanganisa konke okudingayo mayelana nombono wekhompyutha namamojula afinyelelekayo.

Ukucushwa kwe-Hardware yamaphrojekthi we-Computer Vision

inqwaba yombono

Ukusebenzisana umbono wokufakelwa Ku-Arduino, kubalulekile ukuqala nge- ukumisa okulungile ye-hardware. Imojula yekhamera ye-OV7670 ingenye yezinketho ezidume kakhulu ngenxa yezindleko zayo eziphansi nokuguquguquka. Le module ingaxhunywa kumabhodi afana I-Arduino Nano 33 BLE Sense. Inzuzo enkulu yale khamera ukusekelwa kwayo kwezinqumo ze-VGA (640 x 480) nokuhlanganiswa kwayo namathuluzi afana ne-TensorFlow Lite Micro kumaphrojekthi okufunda ngomshini.

Ukufaka kokuqala, uzodinga:

  • I-motherboard ehambisanayo, njenge-Arduino Nano 33 BLE Sense.
  • Imojuli yekhamera ye-OV7670.
  • Amakhebuli okwenza ukuxhumana ngendlela efanele.
  • Ukunikezwa kwamandla okufanelekile.

Inselele enkulu isekuhlanganiseni okuhlukile izikhonkwane zemojuli ku-motherboard. Ukunemba kuyisihluthulelo lapha, njengoba ukuxhumeka okungalungile kungase kuholele ekuhlulekeni. Ukusebenzisa itheyiphu ukuze uvikele izintambo kuyisixazululo esilula kodwa esisebenzayo.

Ukucushwa Kwesofthiwe

Uma i-hardware isilungile, isinyathelo esilandelayo ukulungiselela imvelo yokuthuthukiswa. I-Arduino IDE iyithuluzi elivame kakhulu lokuhlanganisa nokulayisha izinhlelo ebhodini. Kusukela kumphathi welabhulali, ungafaka umtapo wezincwadi we-Arduino_OVD767x, oklanyelwe ngokuqondile ukusebenza ngale khamera.

Izinyathelo zokumisa isoftware:

  • Landa futhi ufake i-Arduino IDE.
  • Vula isiphathi selabhulali kokuthi 'Amathuluzi'.
  • Thola ilabhulali ye-Arduino_OV767x futhi uyifake.

Uma isifakiwe, ungahlola isistimu usebenzisa isibonelo esifakiwe se-CameraCaptureRawBytes. Phakathi nalesi sigaba, imojula izoqala ukukhipha izithombe kanambambili ezingaphekiwe ngembobo ye-serial. Uma yonke into icushwe ngendlela efanele, kufanele ukwazi ukubonisa a iphethini yokuhlola ngaphambi kokuqhubeka nezithombe ezibukhoma.

Ukuthuthukisa I-Computer Vision nge-TinyML

Kuzinhlelo zokusebenza ezithuthuke kakhulu, njengalezo ezisekelwe ku ukufunda okuzenzakalelayo, kubalulekile ukuthuthukisa isistimu ukuze iphathe inani elikhulu ledatha. Isibonelo, izithombe ze-VGA zidla cishe 300 KB yenkumbulo, eyeqa umthamo wamabhodi njenge-Nano 33 BLE Sense.

Ukuxazulula le nkinga, imojula ye-OV7670 ikuvumela ukuthi usebenze nayo izinqumo eziphansi njenge-QVGA (320×240) noma i-QCIF (176×144), ukulungisa idatha ngaphambi kokuyithumela ku-Arduino. Ungaphinda ukhethe okuhlukile amafomethi ombala njenge-RGB565 noma i-YUV422, kuye ngezidingo zephrojekthi. Lawa mafomethi achaza ukuthi amanani ombala agcinwa kanjani ngaphakathi ngalinye pixel ukuthuthukisa ukusetshenziswa kwememori.

Amanye amaphrojekthi aze anciphise isixazululo ngokuqhubekayo ngokufaka isicelo isampula phansi, ukususa amaphikseli ngamasu noma amanani afaka phakathi ukuze kugcinwe ikhwalithi yokubuka. Lesi sinyathelo sibalulekile uma usebenza ngamamodeli okufunda ajulile, afana ne-TensorFlow, evame ukudinga izithombe ezincane ukuqeqeshwa okuphumelelayo.

Ukusetshenziswa Okungokoqobo: Ukuqashelwa Kwento nge-Pixy2

Enye imojuli ethokozisayo yile I-Pixy2, exhumeka kalula kumabhodi e-Arduino ukuze isebenzise ukuqashelwa kwento. Le divayisi iyakwazi ukuhlonza izinto ezingafika kweziyisikhombisa ngesikhathi sangempela futhi ihlanganise ukusebenza kwayo nezikrini ze-OLED noma izidlali zomsindo.

I-Pixy2 iphinde igqame ngekhono layo lokubona imigqa futhi sikhiqize amabhakhodi amancane, aklanyelwe ngokuqondile amarobhothi alandela izindlela ezimakiwe. Ukuze uyilungiselele, ungasebenzisa isofthiwe I-Pixymon, ukudizayina amasiginesha emibala ezinto ezahlukene okumele isistimu izikhombe.

Ukuthuthukiswa Kwenqubo Kombono Wokwenziwa

Sebenzisana no umbono wokufakelwa Ku-Arduino kudinga ukwenza kahle kokubili ihadiwe nesofthiwe. Isibonelo, imisebenzi efana ne-digitalRead ne-digitalWrite ingabambezela ukuthwebula idatha uma ingasetshenziswa kahle. Esikhundleni salokho, phatha ngqo amachweba we-GPIO usebenzisa imiyalo eqondile ingasheshisa kakhulu inqubo.

Amanye amathiphu abalulekile wokuthuthukisa ukusebenza kahle:

  • Sebenzisa izinqumo eziphansi njenge-QCIF ezinhlelweni ezingadingi ikhwalithi ephezulu.
  • Yenza ikhodi ibe lula ngokususa izihibe ezingadingekile.
  • Cabangela ukusebenzisa amasu e-SIMD ukuze usebenze ngokushesha kuma-CPU ahambisanayo.

Endabeni yemojula ye-OV7670, ukuthuthukiswa kwakamuva kumtapo wezincwadi we-Arduino_OV767x kwenze kwaba nokwenzeka ukudlulisa. izithombe enkumbulweni ngesivinini esimangalisayo. Isibonelo, bekungenzeka ukunciphisa isikhathi sokuthwebula idatha ye I-1500 ms nje I-393 ms yezithombe ze-QCIF.

Isebenzisa i-TensorFlow Lite Micro

Kulabo abafuna ukuyisa amaphrojekthi abo ezingeni elilandelayo, i-TensorFlow Lite Micro inikeza amathuluzi akhethekile ongasebenza nawo ukuhlakanipha okufakelwayo kuma-microcontroller. Le labhulali ethuthukisiwe ingathola amaphethini athuthukile njengokubonwa kobuso noma ukutholwa kokuthinta, kusetshenziswa amamodeli aqeqeshwe kusengaphambili ashunwe amadivayisi avinjwe yinsiza.

Le ndawo iphinde izuze ekuthuthukisweni kwakamuva okufana ne-CMSIS-NN, enciphisa ngokumangazayo isikhathi sokuqagela ngokusebenzisa imiyalelo eqondene nephrosesa efana I-SIMD. Ngakho-ke, izinhlelo zokufunda ngomshini ku-Arduino manje sezishesha kakhulu futhi zisebenza kahle kakhulu.

Ukuzulazula emhlabeni wombono wekhompyutha nge-Arduino kuwukuzizwisa okucebisayo. Kusukela ekusetheni amakhamera abiza kancane kuya ekusebenziseni ama-algorithms okufunda komshini, amathuba cishe awanamkhawulo. Ngendlela yokudala kanye nezinsiza ezifanele, ungahlola izindawo ezifana ukuqashelwa kwento, ukulandelela umugqa noma amaphrojekthi obuhlakani bokwenziwa athuthukile ngesikhathi sangempela.


Yiba ngowokuqala ukuphawula

Shiya umbono wakho

Ikheli lakho le ngeke ishicilelwe. Ezidingekayo ibhalwe nge *

*

*

  1. Ubhekele imininingwane: Miguel Ángel Gatón
  2. Inhloso yedatha: Lawula Ugaxekile, ukuphathwa kwamazwana.
  3. Ukusemthethweni: Imvume yakho
  4. Ukuxhumana kwemininingwane: Imininingwane ngeke idluliselwe kubantu besithathu ngaphandle kwesibopho esisemthethweni.
  5. Isitoreji sedatha: Idatabase ebanjwe yi-Occentus Networks (EU)
  6. Amalungelo: Nganoma yisiphi isikhathi ungakhawulela, uthole futhi ususe imininingwane yakho.