Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Real-time automatic checkout via prompt-based product extraction and cross-domain learning
Jönköping University, School of Engineering. University of Skövde; ITAB Shop Products AB, Jönköping, Sweden.
Jönköping University, School of Engineering, JTH, Department of Computer Science and Informatics.ORCID iD: 0000-0003-2900-9335
Jönköping University, School of Engineering, JTH, Department of Computing, Jönköping AI Lab (JAIL).ORCID iD: 0000-0003-0274-9026
2024 (English)In: 2024 International Conference on Machine Learning and Applications (ICMLA), Miami, FL, USA: IEEE, 2024, p. 1396-1403Conference paper, Published paper (Refereed)
Abstract [en]

Automatic checkout systems are designed to predict a complete shopping receipt using an image from the checkout area. These systems require high classification accuracy across numerous classes and must operate in real-time, despite domain differences between training data and real-world conditions. Building on recent advancements, we propose a method that outperforms current solutions and can be applied in real-time in automatic checkout systems. Our method leverages the Segment Anything Model to extract high-quality masks from lab product images, which are then transformed into synthetic checkout images and adapted to the real domain using contrastive unpaired translation. We train a product recognition model with data augmentation, named SCA+Y8, and further improve it through fine-tuning with pseudo-labels from unlabeled checkout images, resulting in an improved model called SCAFT+Y8. SCAFT+Y8 achieves a great increase in state-of-the-art performance, with an average receipt classification accuracy of 97.58%, and shows strong performance in smaller models, indicating the potential for deployment on low-cost edge devices.

Place, publisher, year, edition, pages
Miami, FL, USA: IEEE, 2024. p. 1396-1403
Keywords [en]
Automatic Checkout, YOLOv8, Object Detection, Domain Adaptation
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:hj:diva-67412DOI: 10.1109/ICMLA61862.2024.00217ISI: 001468515500208Scopus ID: 2-s2.0-105000879245ISBN: 979-8-3503-7489-6 (print)ISBN: 979-8-3503-7488-9 (electronic)OAI: oai:DiVA.org:hj-67412DiVA, id: diva2:1943595
Conference
2024 International Conference on Machine Learning and Applications (ICMLA), 18-20 December 2024
Available from: 2025-03-11 Created: 2025-03-11 Last updated: 2025-10-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Riveiro, MariaLöfström, Tuwe

Search in DiVA

By author/editor
Riveiro, MariaLöfström, Tuwe
By organisation
School of EngineeringJTH, Department of Computer Science and InformaticsJönköping AI Lab (JAIL)
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 5046 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf