S&M Young Researcher Paper Award 2020
Recipients: Ding Jiao, Zao Ni, Jiachou Wang, and Xinxin Li [Winner's comments]
Paper: High Fill Factor Array of Piezoelectric Micromachined
Ultrasonic Transducers with Large Quality Factor

S&M Young Researcher Paper Award 2021
Award Criteria
Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 33, Number 11(3) (2021)
Copyright(C) MYU K.K.
pp. 4057-4068
S&M2745 Research Paper of Special Issue
https://doi.org/10.18494/SAM.2021.3528
Published: November 30, 2021

Interactive Sound Generation to Aid Visually Impaired People via Object Detection Using Touch Screen Sensor [PDF]

Tias Kurniati, Chuan-Kai Yang, Tzer-Shyong Chen, Yu-Fang Chung, Yu-Min Huang, and Chih-Cheng Chen

(Received July 1, 2021; Accepted October 25, 2021)

Keywords: sound generation, touch sensor, object detection, image processing

Along with the invention of portable devices, such as smartphones and tablets, computer-based touch screen sensor-assistive technologies have become significantly more affordable than traditional tactile graphics. The sensor panel in these technologies allows users to receive visual and auditorial responses via interaction with the device. However, visually impaired individuals (with a lack or loss of ability to see) will not find visual responses useful when using tablets or smartphones. Therefore, in this paper we propose a system that helps visually impaired people comprehend information on electronic devices with the help of auditory action feedback. We develop a multimedia system for sound production from a given image via object detection. In this study, YOLO (You Only Look Once) is used in object detection for sonification. A pre-trained model is used; thus, a wider range of object classification can be identified. The system generates the corresponding sound when an object on the sensor screen is touched. The purpose of our research is to aid visually impaired people to perceive information of a picture shown on the device by touching the detected object. The device was tested by simulating visually impaired people by blindfolding people with normal vision, who filled out questionnaires on its performance. The results indicate that most of the users found that the sound presented by the device was helpful for telling them what the shown image was.

Corresponding author: Tzer-Shyong Chen, Chih-Cheng Chen


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Tias Kurniati, Chuan-Kai Yang, Tzer-Shyong Chen, Yu-Fang Chung, Yu-Min Huang, and Chih-Cheng Chen, Interactive Sound Generation to Aid Visually Impaired People via Object Detection Using Touch Screen Sensor, Sens. Mater., Vol. 33, No. 11, 2021, p. 4057-4068.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Advanced Methods and Devices for Remote Sensing
Guest editor, Lei Deng and FuZhou Duan (Capital Normal University, Beijing)


Special Issue on Microfluidics and Related Nano/Microengineering for Medical and Chemical Applications
Guest editor, Yuichi Utsumi (University of Hyogo)
Call for paper


Special Issue on International Conference on BioSensors, BioElectronics, BioMedical Devices, BioMEMS/NEMS and Applications 2019 (Bio4Apps 2019) (2)
Guest editor, Hirofumi Nogami and Masaya Miyazaki (Kyushu University)
Conference website


Special Issue on Biological Odor Sensing System and Their Applications
Guest editor, Takeshi Sakurai (Tokyo University of Agriculture)


Special Issue on High-sensitivity Sensors and Sensors for Difficult-to-measure Objects
Guest editor, Ki Ando (Chiba Institute of Technology)
Call for paper


Special Issue on Sensing Technologies and Their Applications (II)
Guest editor, Rey-Chue Hwang (I-Shou University)
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.