CHAPTER 1 INTRODUCTION

 

CHAPTER 1

INTRODUCTION

1.1 INTRODUCTION

               This project aims to provide the user to experience augmented reality using haptic gloves. These haptic gloves allows the user to get in communication with the computer device with the use of haptic technology. It is a kind of wearable device that allows a user to connect virtually with the computer devices using Arduino code which read the status of the hall sensors and broadcast them using the Bluetooth module.

1.2 FUNCTIONAL REQUIREMENTS:

     System application should provide us an UI (user interface) and track the position of our hand using Image processing. Arduino should transmit the click status of the hall sensors to the Computer wirelessly via Bluetooth. 

1.3 NON FUNCTIONAL REQUIREMENTS:  

1.  The system should be compact in size
2.   The system should be easily configurable
3.    Mounting arrangement should be simple.
4.    External wiring required should be minimal

 1.4 INTRODUCTION TO HAPTIC TECHNOLOGY:

               This word, ‘haptic’ is derived from the Greek word "haptikos," which simply means a ‘sense of touch’.  Haptic refers to the technology that uses human touch to control and interact with computers. A user May apply a sense of touch through any means like vibrations, motion or it may be force. Haptic technology is primarily used in creating virtual objects, controlling the virtual objects and in the improvement of the remote control of machines and devices. 

1.5 TYPES OF HAPTIC SYSTEMS

Haptic systems are classified into three types based on the type they are used

They are

1.       Wearables
2.       Touchable
3.       Graspable

FIGURE: 1.5.1 TYPES OF HAPTIC SYSTEMS

1.6 HOW WE USE HAPTIC TECHNOLOGY IN OUR PROJECT 

               In this project we made haptic gloves based on augmented reality .By using this gloves we can simply wave our hand in front of the computer and move the pointer to the desired location and perform some tasks. To make this happen we have used the power of Arduino and processing combined. Processing is an application just like Arduino. Using Processing we can create simple system applications, Android applications and much more.

               It also has the ability to do Image Processing and Voice recognition. In this project we are using processing to create a simple System application which provides us    an UI (user interface) and track the position of our hand using Image processing.

               We have made left click and right click using our fingers. To make that happen we have used two hall sensors (one on index finger and the other on middle finger) which will be read by the Arduino Nano. The Arduino also transmits the click status to the Computer wirelessly via Bluetooth.

               The Arduino, resistors and the berg stick pins are soldered on a PCB (printed circuit board) board. The hall sensor and the Bluetooth module is soldered to a connector wire. We have assembled all this onto gloves so that it is easy to use. The magnet is placed on thumb finger and the hall sensor1 and hall sensor2 are placed on index and middle fingers respectively. The purpose of the Arduino code is it    to read the status of the hall sensor and broadcast them using the Bluetooth module. 

               It also receives the data from Bluetooth and toggle the on-board LED based on the incoming value. The purpose of the Processing program is to create a system application which can act as an UI (User interface) and also perform image processing to track a particular object. In this case we track the blue object that we    stuck to our gloves above. The program basically has four screens, they are Calibration Screen, Main Screen, Paint Screen, and LED toggle Screen .We can navigate from one screen to another by simply waving our hands and dragging screens on air. We can also make clicks on desired places to toggle LED or even draw something on screen. 

               Once the Hardware and software is ready, we have to wear the gloves and get ready for some action. We just simply power the Arduino and then launch the Application. The led on the Bluetooth module will goes stable. Now it means that our System application has established a Bluetooth link with our Arduino. We will get a screen on the desktop where we have to select the object to be tracked. This tracing can be simply done by clicking on the object. In this case the object is the Blue disc.we can move our object and notices that the pointer follows the object. We have used a unique colour object for best results.

               By touching your thumb finger with index finger and we get a message “Key 1 Pressed” and the when we press our thumb with middle finger we see that “Key 2 Pressed” this indicates that everything works fine and the calibration is over. Now we have to click on the done button. Once the Done button is pressed we will be directed to the main screen where we can paint on air or toggle the LED on the Arduino Board.