Designing and implementing an infrared touch panel based on pattern recognition

Number of pages: 88 File Format: word File Code: 31083
Year: 2013 University Degree: Master's degree Category: Computer Engineering
  • Part of the Content
  • Contents & Resources
  • Summary of Designing and implementing an infrared touch panel based on pattern recognition

    Master's Thesis of Computer Engineering (Artificial Intelligence)

    Abstract

    Design and implementation of an infrared touch panel based on

    pattern recognition

    The issue of positioning has always been controversial as the basis of issues raised in all types of touch screens, the meaning of positioning is to recognize the location of the finger or fingers placed on the surface of the touch screen. Touch due to the material used in their construction has caused a huge challenge in the way of making touch screens to increase the accuracy of positioning. In this thesis, first by examining the common touch screens, a new method for positioning regardless of the material used in the touch screen is presented. This method is a combination of Liu's [1] signal analysis method in acoustic touch panels [2] and touch panels made of infrared sensors provided by Moeller [3]. The most important difference between the presented method and the previous methods, in addition to the provided hardware, is the way of data analysis and the change in data modeling using the nearest neighbor method [4]. The results show the improvement of the performance of this method compared to Liu's method presented in the new platform.

    Also, the use of this technology has become widespread in such a way that most of the industrialized countries of the world have a special desire to use it in their various products, for example, during the surveys conducted by the American DisplaySearch Institute in 2010, the most use of touch screens was in Japanese and American products. (Figure 1-2 shows this issue.) [2]. This, in the surveys conducted by the same institute in 2011, it is predicted that the amount of purchase of this product will increase by 105% by 2014. (more than twice compared to 2011) which shows the importance of this technology. (Figure 1-3) [3].

    1-2- Classification of touch screens

    Since the emergence of this technology, various types of touch screens have been produced and presented, and with the passage of almost three decades since the first model of this technology was made and presented, the issues raised in this field are still attractive and of interest to researchers in various sciences. Due to the wide range of manufacturers and the diversity of research in this field, various classifications have been presented so far for different types of touch screens, the most famous of which are: a) Wigdor classification This type of classification is based on the received data and how to process the desired touch screen as shown in Figure 1-5 [47]. b) Walker classification This classification is based on the type of platform, the degree of transparency Screen etc. is divided Figure 1-4 shows this type of classification [40].

         c) Classification of the American Institute of Display Search [1]

    In this type of classification, the criteria is the type of sensors and the manufacturing technology of each of the touch screens which is drawn as a diagram in Figure 1-6[46].

    Presenting a new classification

    As mentioned, each of these categories It is provided for a specific purpose and by a specific person or institution. Since the topic studied in this treatise is about the issue of positioning - detecting the location of the finger or fingers placed on the surface of the touch screen - in touch screens, therefore this issue is not fully mentioned in any of the above categories and it cannot be included in these categories, so here a new category is presented which is a combination of the above categories and covers the issues raised in this treatise as well, which is presented as follows:

    Here the screen performance criteria show, as mentioned, many companies and organizations have been active in the field of touch screens and each of them have adopted their own policy to solve the positioning problem, which can be included in two categories, which are: Exact base: in some researches, hardware methods have been used to increase the accuracy and speed of positioning. Methods such as: increasing the number of sensors, the location and placement of sensors, changing the size and miniaturization of sensors, etc.

    Approximation base: in this category modeling, signal analysis and data processing are used instead of hardware methods.Touch Sensing Technology Approximation base wave

    Image processing

    Diffuse Illumination

    Inverted FTIR

    FTIR

    Light Plane

    Touchscreens can also be divided into two different categories in terms of the body [2], the overall classification as shown in Figure 7-1 is assumed:

    In this new dissertation, the goal is to create a category It is one of the touch screens that combines the methods presented in the Acoustic wave type screens from the Approximation base touch screen category and the Infrared type screens from the Exact base category in such a way that the designed infrared type substrate is selected and the signal analysis methods provided in Aciustic type are applied on the data taken from this substrate. The main goal of this method is to provide a solution to reduce costs and reduce the hardware dependence of infrared touch screens. In this case, a new sub-group named Infrared wave is introduced in the proposed classification method.

    1-3- A brief history of the development and innovation of existing touch technologies:

    For the first time, in 1965, Johnson spoke about a simple structure that was the basis of capacitive touch screens [8], after that his detailed article in 1967, which was a theory about a new technology called touch screens [9] was published. Then, for the first time in 1968, an article was published that used this technology in air traffic control [10,11]. After that, the first capacitive touch screens were made by Benck at the WERN Institute in the early 1970s and used in 1973 [12].  Then, while working as a professor at the University of Kentucky Research Institute, Hurst invented the first resistive touch sensor called the Elograph, which allowed him to enter content faster. Elographics company was born next to this invention, this device was not similar to today's sensors; But this achievement was a big step towards new touch screens. Three years later, in 1974, Hurst designed the first transparent touch screen, and in 1977 he invented the Elograph and patented the resistive 5-Wire technical method, which is still the most widely used method. This technology was produced and used industrially in 1982 [13]. After that, from 1986 onwards, efforts were made to expand its use in various devices, in these years, the first graphical touch screen was presented, in the early 1990s, the first academic research was conducted by Sears [14], and in the late 1990s and early 2000s, the use of this type of touch screens in computer games became very prosperous, and until 2004, this accounted for the largest consumer market, but then From the presentation of touch screens by Nitendo and its reception, the use of touch screens has been greatly expanded and extended to personal computers [15]. Since the beginning of 2000, various and more complex types of touch screens have been provided, which we will examine in detail below. The sensors used in it are divided into several categories such as resistive, acoustic, capacitive, infrared, image, signal and sound. Since there have been many changes in this field since the mid-1960s, and a detailed description of each of them is not possible in this treatise, therefore, we will limit ourselves to a brief overview of each of them in just a few lines, which are:

    -

    -

    -Sine wave output sensor capacitor

    -Infrared[3]

    - Background lights

    -Piezoelectric transducer

    -Signal

    1-5- Conclusion and description of the general process of the dissertation

    As stated, in the past years, extensive research has been done in the field of developing and using different types of touch screens. So that even in some sources, studies have been done on how to design the graphic interface of software related to touch screens, or the best way to define user protocols in different types of touch screens, or their use in moving vehicles [25-26].

  • Contents & References of Designing and implementing an infrared touch panel based on pattern recognition

    List:

    The first chapter. 1

    1- Introduction 2

    1-1- Introduction 2

    1-2- Classification of touch screens 4

    1-3- A brief history of the development and creation of various touch technologies available: 8

    1-4- Different types of touch screens until today 9

    1-5- Conclusion and description of the general process of the treatise 11

    The second chapter. 12

    2- Recent research in the field of making touch screens. 13

    2-1- Introduction 13

    2-2- Full description of Liu method 16

    2-3- Full description of Moeller method 25

    2-4- Summary 29

    Chapter three. 30

    3- Presenting a new platform, analyzing the existing methods in this platform and presenting a new method. 31

    3-1- Introduction 31

    3-2- Presentation of a new platform 31

    3-3- Presentation of an efficient method in a new platform 47

    3-4- Conclusion 51

    Chapter 4 52

    4- Experiments and results. 53

    4-1- Introduction 53

    4-2- Sampling method 53

    4-3- Specifications of the computer used in this research 56

    4-4- Results obtained and their comparison 56

    4-5- Summary 58

    Chapter 5 59

    5- Conclusion. 60

    5-1- Introduction 60

    5-2- Future researches 60

    Sixth chapter 62

    6- Appendices 63

    6-1- Geometric specifications of the designed touch screen 63

    6-2- Calculation of the output voltage value as a sample 63

    6-3- Sensor specification sheets 66

    7- List of sources. 77

     

     

    Source:

     

    1.         San Jozeh, "Touch Screen Market Update", DisplaySearch Co. November 10, 2010.

    2.         Jennifer Colegrove, "The State of the Touch-Screen Market in 2010", Display Searc Co., ID- Report: 0362-0972, 2010

    3.         Jennifer Colegrove, "The State of the Touch-Screen Market in 2011", Display Searc Co., ID- Report: 0362-0972, 2011

    4.         Adiwahono, A.H.C.-M.C.W.H.V.H.D., Humanoid Robot Push Recovery through Walking Phase Modification. IEEE Conference on Robotics Automation and Mechatronics, pp. 5, 2010.

    5.         Yong S. Park, Sung H. Han," Touch key design for one-handed thumb interaction with a mobile phone: Effects of touch key size and touch key location", International Journal of Industrial Ergonomics, pp 68-76, 2010.

    6.         Hyung-Kew Lee, Sun-Il Chang, and Euisik Yoon, "A Flexible Polymer Tactile Sensor: Fabrication and Modular Expandability for Large Area Deployment", Journal of Microelectromechanical System, vol. 15, no. 6, 2006.

    7.         Sunghyuk Kwon, Chungsik Kim, Sujin Kim, Sung H. Han,"Two-mode target selection: Considering target layouts in small touchscreen devices", International Journal of Industrial Ergonomics, pp. 733-745, 2010.

    8.         Johnson, E.A. . "Touch Display - A novel input/output device for computers". Electronics Letters, pp. 219-220, 1965.

    9.         Johnson, E.A., "Touch Displays: A Programmed Man-Machine Interface". Ergonomics, pp. 271–277, 1967.

    10.       Orr, N. W.; Hopkins, V.D. "The Role of Touch Display in Air Traffic Control.", 1968.

    11.       D. M. USHER, C. ILETT, "Touch-screen techniques: performance and application in power station control displays", Displays System Institute, pp. 59-66, 1986

    12.       "Another of CERN's many inventions!", CERN Bulletin Issue 12/2010 & 13/2010.

    13.       "G. Samuel Hurst - the 'Tom Edison' of ORNL", December 14 2010. Available at: http://oakridger.com. Adopted from: http://WikiPedia.com.

    14.       Sears, A., Plaisant, C., Shneiderman, B. "A new era for high-precision touchscreens". Advances in Human-Computer Interaction, vol. 3, 1990.

    15.       Travis Fahs. "IGN Presents the History of SEGA". IGN. pp. 7. April 21, 2009.

    16.       R. S. Cok, R.R. Bourdelais, C.J. Kaminsky, "Flexible resistive touch screen", USPatent

    2004/0212599 A1, 2004.

    17.       Patschon, Mark "Acoustic touch technology adds a new input dimension." Computer Design. pp. 89–93, 1988.

    18.             Xinlin Ye, JianJu Liu, Xinbin Liu,"Infrared Touch Screen", States Patent 0249458 A1, 2012.

    19.       Murakami, K.K.a.K., Moving Object Tracking via One-Dimensional Optical Flow Using Queue. International Conference on Control, Automation, Robotics and Vision, 2008, pp. 4.

    20.       Jon Moeller, Andruid Kerne,” ZeroTouch: An Optical Multi-Touch and Free-Air Interaction Architecture”, ACM Conference, Session: Dimensions of Sensory Interaction HI, pp.5–10, Austin, Texas, USA, May 2012.

    21.       Beyers, Tim. "Innovation Series: Touchscreen Technology". The Motley Fool. 2008.

    22.       "Acoustic Pulse Recognition Touchscreens". Elo Touch System Journal, Elo Touch System Co., pp. 3, 2006.

    23.       Y. Liu, J.P. Nikolovski, N. Mechbal, M. Hafez, M. Vergé, "An acoustic multi-touch sensing method using amplitude disturbed ultrasonic wave diffraction patterns", Sensors and Actuators A: Physical Journal, pp. 394–399, 2010.

    24.       Liqun Du, Guiryong Kwon, Fumihito Arai, Toshio Fukuda, Kouichi Itoigawa, Yasunori Tukahara,"Structure design of micro touch sensor array", Sensors and Actuators Journal, pp.7-13, 2003.

    25.       Ying-Lien Lee, "Comparison of the conventional point-based and a proposed ?nger probe-based touch screen interaction techniques in a target selection task", International Journal of Industrial Ergonomics, p.p 655-662, 2010.

    26. Paul M. Salmon, Michael G. Lenné, Tom Triggs, Natassia Goode, Miranda Cornelissen, Victor Demczuk, "The effects of motion on in-vehicle touch screen system operation: A battle management system case study”, Transportation Research Part F, 2012.

    27. Chia-Hsing Pi, Kuang-Shun Ou, Kuo-Shen Chen,” A one-dimensional touch panel based on strain sensing”, 2012 Li, Yi-Ming Chang, Tsung-Chih Lin, Jiann-Fuh Chen, and U.-Chen Lin,” Pressure Sensitive Stylus and Algorithm for Touchscreen Panel”, Journal of Display Technology, IEEE, 2012.

    29.       im H-K, Lee S, Yun K-S," Capacitive tactile sensor array for touch screen application" Sens Actuat A: Phys, p 2-7 , 2011.

    31.       I.-S. Yang and O.-K. Kwon, "A Touch Controller Using Differential Sensing Method for On-Cell Capacitive Touch Screen Panel Systems", IEEE Transactions on Consumer Electronics, Vol. 57, No. 3, p1027-1032, 2011.

    32.       Chenchi Luo, Milind A. Borkar, Arthur J. Redfern, and James H. McClellan, "Compressive Sensing for Sparse Touch Detection on Capacitive Touch Screens", IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2012.

    33.       Katsuki T, Nakazawa F, Sano S, Takahashi Y, Satoh Y "A compact and high optical transmission SAW touch screen with ZnO thin-film piezoelectric transducers", Proceedings of the IEEE ultrasonics symposium, vol. 1, pp. 24-821, 2003.

    34.       Y. Liu, J.P. Nikolovski, N. Mechbal, M. Hafez, and M. Vergé "An acoustic multi-touch sensing method using amplitude disturbed ultrasonic wave diffraction patterns," Sensors and Actuators A: Physical, 2010

    35.       Y. Liu, J.P. Nikolovski, N. Mechbal, M. Hafez, M. Vergé, "Tactile objects based on an amplitude disturbed diffraction pattern method", Applied Physics Letters, Lett. 95, 2009.

    36.       Jon Moeller, Andruid Kerne,"ZeroTouch: An Optical Multi-Touch and Free-Air Interaction Architecture", CHI 2012, May 5–10, Austin, Texas, USA, 2012.

    37.       Jon Moeller, Andruid Kerne,"Scanning FTIR: Unobtrusive Optoelectronic Multi-Touch Sensing through Waveguide Transmissivity Imaging", TEI 2010, Cambridge, Massachusetts, USA, January 25–27, 2010.

    38

Designing and implementing an infrared touch panel based on pattern recognition