The Food Recognition Benchmark: Using Deep Learning to Recognize Food in Images
The automatic recognition of food on images has numerous interesting applications, including nutritional tracking in medical cohorts. The problem has received significant research attention, but an ongoing public benchmark on non-biased (i.e., not scraped from web) data to develop open and reproducible algorithms has been missing. Here, we report on the setup of such a benchmark using publicly available food images sourced through the mobile MyFoodRepo app used in research cohorts. Through four rounds, the benchmark released the MyFoodRepo-273 dataset constituting 24,119 images and a total of 39,325 segmented polygons categorized in 273 different classes. Models were evaluated on private tests sets from the same platform with 5,000 images and 7,865 annotations in the final round. Top-performing models on the 273 food categories reached a mean average precision of 0.568 (round 4) and a mean average recall of 0.885 (round 3), and were deployed in production use of the MyFoodRepo app. We present experimental validation of round 4 results, and discuss implications of the benchmark setup designed to increase the size and diversity of the dataset for future rounds..
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:9 |
|---|---|
| Enthalten in: |
Frontiers in Nutrition - 9(2022) |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Sharada Prasanna Mohanty [VerfasserIn] |
|---|
| Links: |
doi.org [kostenfrei] |
|---|
| Themen: |
Artificial intelligence (AI) |
|---|
| doi: |
10.3389/fnut.2022.875143 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
DOAJ032294476 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | DOAJ032294476 | ||
| 003 | DE-627 | ||
| 005 | 20230502124328.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230226s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.3389/fnut.2022.875143 |2 doi | |
| 035 | |a (DE-627)DOAJ032294476 | ||
| 035 | |a (DE-599)DOAJc3edb5dd906c4b4395606fe8a007fb53 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 050 | 0 | |a TX341-641 | |
| 100 | 0 | |a Sharada Prasanna Mohanty |e verfasserin |4 aut | |
| 245 | 1 | 4 | |a The Food Recognition Benchmark: Using Deep Learning to Recognize Food in Images |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a The automatic recognition of food on images has numerous interesting applications, including nutritional tracking in medical cohorts. The problem has received significant research attention, but an ongoing public benchmark on non-biased (i.e., not scraped from web) data to develop open and reproducible algorithms has been missing. Here, we report on the setup of such a benchmark using publicly available food images sourced through the mobile MyFoodRepo app used in research cohorts. Through four rounds, the benchmark released the MyFoodRepo-273 dataset constituting 24,119 images and a total of 39,325 segmented polygons categorized in 273 different classes. Models were evaluated on private tests sets from the same platform with 5,000 images and 7,865 annotations in the final round. Top-performing models on the 273 food categories reached a mean average precision of 0.568 (round 4) and a mean average recall of 0.885 (round 3), and were deployed in production use of the MyFoodRepo app. We present experimental validation of round 4 results, and discuss implications of the benchmark setup designed to increase the size and diversity of the dataset for future rounds. | ||
| 650 | 4 | |a deep learning | |
| 650 | 4 | |a benchmark | |
| 650 | 4 | |a food recognition | |
| 650 | 4 | |a images | |
| 650 | 4 | |a artificial intelligence (AI) | |
| 653 | 0 | |a Nutrition. Foods and food supply | |
| 700 | 0 | |a Gaurav Singhal |e verfasserin |4 aut | |
| 700 | 0 | |a Eric Antoine Scuccimarra |e verfasserin |4 aut | |
| 700 | 0 | |a Djilani Kebaili |e verfasserin |4 aut | |
| 700 | 0 | |a Harris Héritier |e verfasserin |4 aut | |
| 700 | 0 | |a Victor Boulanger |e verfasserin |4 aut | |
| 700 | 0 | |a Marcel Salathé |e verfasserin |4 aut | |
| 700 | 0 | |a Marcel Salathé |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i In |t Frontiers in Nutrition |d Frontiers Media S.A., 2014 |g 9(2022) |w (DE-627)DOAJ00003178X |x 2296861X |7 nnns |
| 773 | 1 | 8 | |g volume:9 |g year:2022 |
| 856 | 4 | 0 | |u https://doi.org/10.3389/fnut.2022.875143 |z kostenfrei |
| 856 | 4 | 0 | |u https://doaj.org/article/c3edb5dd906c4b4395606fe8a007fb53 |z kostenfrei |
| 856 | 4 | 0 | |u https://www.frontiersin.org/articles/10.3389/fnut.2022.875143/full |z kostenfrei |
| 856 | 4 | 2 | |u https://doaj.org/toc/2296-861X |y Journal toc |z kostenfrei |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_DOAJ | ||
| 912 | |a SSG-OLC-PHA | ||
| 951 | |a AR | ||
| 952 | |d 9 |j 2022 | ||