SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Maximilian Schrapel
  • Philipp Etgeton
  • Michael Rohs
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021
ErscheinungsortNew York, NY, US
Herausgeber (Verlag)Association for Computing Machinery (ACM)
Seiten1-5
ISBN (elektronisch)9781450380959
PublikationsstatusVeröffentlicht - Mai 2021
VeranstaltungCHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths (CHI EA 2021) - Virtual, Online, Japan
Dauer: 8 Mai 202113 Mai 2021

Publikationsreihe

NameConference on Human Factors in Computing Systems - Proceedings

Abstract

We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.

ASJC Scopus Sachgebiete

Zitieren

SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs. / Schrapel, Maximilian; Etgeton, Philipp; Rohs, Michael.
Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021. New York, NY, US: Association for Computing Machinery (ACM), 2021. S. 1-5 336 (Conference on Human Factors in Computing Systems - Proceedings).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Schrapel, M, Etgeton, P & Rohs, M 2021, SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs. in Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021., 336, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), New York, NY, US, S. 1-5, CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths (CHI EA 2021), Virtual, Online, Japan, 8 Mai 2021. https://doi.org/10.1145/3411763.3451753
Schrapel, M., Etgeton, P., & Rohs, M. (2021). SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021 (S. 1-5). Artikel 336 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery (ACM). https://doi.org/10.1145/3411763.3451753
Schrapel M, Etgeton P, Rohs M. SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs. in Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021. New York, NY, US: Association for Computing Machinery (ACM). 2021. S. 1-5. 336. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3411763.3451753
Schrapel, Maximilian ; Etgeton, Philipp ; Rohs, Michael. / SpectroPhone : Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs. Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021. New York, NY, US : Association for Computing Machinery (ACM), 2021. S. 1-5 (Conference on Human Factors in Computing Systems - Proceedings).
Download
@inproceedings{d1533554d23a42e2887c08f0e06042e1,
title = "SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs",
abstract = "We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.",
keywords = "Material sensing, Mobile Interaction, Pattern recognition",
author = "Maximilian Schrapel and Philipp Etgeton and Michael Rohs",
year = "2021",
month = may,
doi = "10.1145/3411763.3451753",
language = "English",
series = "Conference on Human Factors in Computing Systems - Proceedings",
publisher = "Association for Computing Machinery (ACM)",
pages = "1--5",
booktitle = "Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021",
address = "United States",
note = "CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths (CHI EA 2021), CHI EA 2021 ; Conference date: 08-05-2021 Through 13-05-2021",

}

Download

TY - GEN

T1 - SpectroPhone

T2 - CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths (CHI EA 2021)

AU - Schrapel, Maximilian

AU - Etgeton, Philipp

AU - Rohs, Michael

PY - 2021/5

Y1 - 2021/5

N2 - We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.

AB - We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.

KW - Material sensing

KW - Mobile Interaction

KW - Pattern recognition

UR - http://www.scopus.com/inward/record.url?scp=85105776624&partnerID=8YFLogxK

U2 - 10.1145/3411763.3451753

DO - 10.1145/3411763.3451753

M3 - Conference contribution

AN - SCOPUS:85105776624

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 1

EP - 5

BT - Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021

PB - Association for Computing Machinery (ACM)

CY - New York, NY, US

Y2 - 8 May 2021 through 13 May 2021

ER -