Arduino Image Processing based Entrance lock Control System
Table of Contents
Arduino Image Processing Project Description:
Arduino Image Processing- This Project is based on Image Processing using Visual Basic 2010 Express Edition, Arduino Uno or Mega, and a 12 Volt Electronic Lock. The purpose of this project is to automatically control the Entrance Lock using Human detection. The humans are tracked in RealTime using the frontal Face XML file, once the human face is detected, then we find the X and Y coordinates of the human face and then send a command to the Arduino Uno or Mega Board to open the Entrance Lock. These commands are sent serially from the Visual Basic application.
The same application can be used to track Eyes, nose, human body, hands, and so on, depending on the type of the XML file we are using. All you need is just to replace the Frontal Face XML file with the one you want. This way you can use this Project to track almost anything you want.
You can also create your custom XML files for tracking a specific object. I will cover this in another Tutorial.
In this project, the EmguCV plays a key role. For the detailed discussions, application designing and program explanation watch a video at the end of this article.
Amazon Links:
Arduino Nano USB-C Type (Recommended)
12v Electronic Door Lock / Elock / Solenoid Lock:
*Disclosure: These are affiliate links. As an Amazon Associate I earn from qualifying purchases.
Softwares used in the Arduino Image Processing:
- Visual Basic 2010 Express Edition
- Arduino IDE
About the Electronic Lock:
Electronic Locks come in different shapes and sizes. But the working principle of all the Electronic Locks is exactly the same. The difference can only be in the voltage and current it requires to energize the coil of the electronic lock. Inside the electronic lock is the coil which creates the magnetic field when the desired voltage is applied.
The Electronic Locks usually has two wires, the voltage wire, and the GND wire. The Electronic lock that we will be using in this project has two wires. The electronic lock can be checked by applying the voltage across the two wires of the electronic lock.
As this project is based on the Automatic entrance controlled system using image processing, in order to control this Electronic Lock automatically we will need a driver circuit for this Electronic Lock. This electronic Lock can be controlled automatically using a relay, an NPN transistor or a MOSFET. As in this project our only aim to open and close the electronic lock, and as we are not using any PWM or fast switching, so in this project Relay is the best choice. Using relay will also provide Isolation.
Arduino Image Processing, Electronic Lock Circuit Diagram:
The circuit diagram as you can see is very simple. The electronic lock is controlled using an SPDT “Single Pole Double Throw” type relay, which is a 12v relay. As you can see in the circuit diagram the 12v wire from the power supply is connected with the electronic lock, it really doesn’t matter which wire you connect it to. The other wire of the electronic lock is connected with the normally open contact of the relay. While the ground of the power supply is connected with the common contact of the relay.
This relay is controlled using the relay driver. The relay driver simply consists of the 2n2222 NPN transistor and a 10k resistor. The selection of the transistor depends on the coil current of the electronic lock. To find the current, first you will need to find the resistance of the electronic lock coil, the voltage is already known which is 12v, then using the Ohm’s law
V = IR
The current can be calculated. Now depending on the current value select any NPN transistor whose collector current is greater than the calculated value. For the best performance select a transistor whose collector current is 3 times greater than the calculated value.
As you can see in the circuit diagram above, this relay is controlled using the digital pin 13 of the Arduino, and make sure you connect the ground of the Arduino with the emitter of the 2n2222 NPN transistor.
Arduino Image Processing Arduino Programming:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
<span style="font-size: 14pt;">int elock = 13; // machine gun trigger motor connected here void setup() { Serial.begin(9600); pinMode(elock, OUTPUT); // keep elock off by default digitalWrite(elock, LOW); } void loop() { // data from computer, as per the image processing. signals from computer for the left and right movement of the machine gun and trigger. while(Serial.available() > 0) // { char received = Serial.read(); if(received == 'd') // human not in front { digitalWrite(elock, LOW); } if(received == 'c') // HUMAN FACE ON front { digitalWrite(elock, HIGH); } } } </span> |
Vb.net Arduino Image Processing Application Programming:
For the Arduino Image Processing application designing, you will need to install the following two Softwares:
Microsoft Visual Basic 2010 express Edition and
EmguCv
The EmguCv installation and setup watch the video available at the end of this Article.
This is how the final form looks like.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 |
Imports Emgu.CV Imports Emgu.CV.Util Imports Emgu.CV.Structure Imports System.Diagnostics Imports System.IO Imports System.IO.Ports Imports System.Threading Public Class Form1 Dim facedetected As Integer Dim facepresent As Integer Dim detectTimecount As Integer Dim web As Capture = New Capture(0) Private Sub Timer1_Tick(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Timer1.Tick ' cars() faces() End Sub Sub faces() Dim photo As Image(Of Bgr, Byte) photo = web.RetrieveBgrFrame Dim currentCenter As New Point() ' Dim eyedetection As New CascadeClassifier("C:\data\haarcascades\haarcascade_eye.xml") ' ' this one is for eye detection Dim facedetection As New CascadeClassifier("C:\data\haarcascades\haarcascade_frontalface_default.xml") ' this one is for the face detection facedetected = 0 Try Dim image As Image(Of Gray, Byte) = photo.Convert(Of Gray, Byte)() For Each face As Rectangle In facedetection.DetectMultiScale(image, 1.1, 8, Size.Empty, Size.Empty) ' default 1.1, 8 ( while best values are 1.2 and 17 after checking) photo.Draw(face, New Bgr(Color.White), 4) currentCenter.X = CInt(CDbl(face.X + face.X + face.Width) / 2.0) currentCenter.Y = CInt(CDbl(face.Y + face.Y + face.Height) / 2.0) Label1.Text = (currentCenter.X).ToString Label2.Text = (currentCenter.Y).ToString Dim f = New MCvFont(Emgu.CV.CvEnum.FONT.CV_FONT_HERSHEY_COMPLEX, 0.5, 0.5) photo.Draw("Human detected and scanning....", f, currentCenter, New Bgr(0, 255, 0)) ' New Point(10, 80) Dim f2 = New MCvFont(Emgu.CV.CvEnum.FONT.CV_FONT_HERSHEY_COMPLEX, 0.7, 0.7) photo.Draw("human detection ", f2, New Point(10, 20), New Bgr(0, 255, 255)) ' New Point(10, 80) Label3.Text = face.ToString facedetected = 1 ' we are storing 1 if faces are detected. Next PictureBox1.Image = photo.ToBitmap Catch ex As Exception End Try If facedetected = 1 Then lblfacedetect.Text = "Scanning..." Timer3.Enabled = True Else lblfacedetect.Text = "no Human..." Timer3.Enabled = False detectTimecount = 0 facepresent = 0 ' SerialPort1.Open() ' SerialPort1.Write("d") ' SerialPort1.Close() End If ' new addition end If detectTimecount >= 3 Then ' HUMAN FACE IN CENTER ' detectTimecount = 0 SerialPort1.Open() Label4.Text = "Human detected" SerialPort1.Write("c") ' the human is on front SerialPort1.Close() End If End Sub Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load SerialPort1.Close() SerialPort1.PortName = "com8" SerialPort1.BaudRate = "9600" SerialPort1.DataBits = 8 SerialPort1.Parity = Parity.None SerialPort1.StopBits = StopBits.One SerialPort1.Handshake = Handshake.None SerialPort1.Encoding = System.Text.Encoding.Default End Sub Private Sub Timer3_Tick(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Timer3.Tick detectTimecount = detectTimecount + 1 Label4.Text = detectTimecount End Sub Private Sub Timer2_Tick(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Timer2.Tick SerialPort1.Open() SerialPort1.Write("d") ' no human SerialPort1.Close() End Sub Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click SerialPort1.Open() SerialPort1.Write("c") ' the human is on front SerialPort1.Close() End Sub Private Sub Button1_Click_1(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click SerialPort1.Open() SerialPort1.Write("c") ' the human is on front SerialPort1.Close() End Sub End Class |
Arduino Image Processing Video Tutorial:
Other Arduino Image Processing Based Projects:
Arduino image processing Eye Pupil Tracking, how to make Haarcascade XML file
