chirpy-starter/_posts/2024-07-04-Tricking.md

title	description	author	date	categories	tags	pin	image
Tricking AI Image Recognition with Minimal Pixel Modifications	Explore how minimal pixel modifications can deceive AI image recognition systems, demonstrated through the RNET classifier.	sanchit	2024-04-05	AI Image Recognition	Machine Learning Computer Vision ResNet50	true	path alt /assets/07-04-2024/1_original.jpeg screenshot

Tricking AI Image Recognition

How many pixels does it take to fool RNET classifier?

Answer : Not Many!

Inspiration : YouTube Video by Computerphile

Classification Model Details

weights = ResNet50_Weights.DEFAULT
model = resnet50

Dataset

https://huggingface.co/datasets/jamescalam/unsplash-25k-photos

Image 1

Initial Prediction: monarch	pixels_modified: 687	After Modification: ringlet

Image 2

Initial Prediction: head cabbage	pixels_modified: 154	After Modification: ice cream

Image 3

Initial Prediction: pay-phone	pixels_modified: 200	After Modification: cash machine

Image 4

Initial Prediction: cliff	pixels_modified: 136	After Modification: promontory

Image 5

Initial Prediction: seashore	pixels_modified: 276	After Modification: promontory

Image 6

Initial Prediction: mountain tent	pixels_modified: 160	After Modification: yurt

Image 7

Initial Prediction: castle	pixels_modified: 673	After Modification: palace

Image 8

Initial Prediction: bubble	pixels_modified: 209	After Modification: fountain

Image 9

Initial Prediction: volcano	pixels_modified: 196	After Modification: torch

Image 10

Initial Prediction: alp	pixels_modified: 472	After Modification: mountain tent

Image 11

Initial Prediction: common iguana	pixels_modified: 595	After Modification: green lizard

Image 12

Initial Prediction: cloak	pixels_modified: 47	After Modification: abaya

Image 13

Initial Prediction: volcano	pixels_modified: 173	After Modification: alp

Image 14

Initial Prediction: torch	pixels_modified: 131	After Modification: beacon

Image 15

Initial Prediction: wool	pixels_modified: 162	After Modification: swab

Image 16

Initial Prediction: jellyfish	pixels_modified: 336	After Modification: isopod

Image 17

Initial Prediction: vase	pixels_modified: 125	After Modification: pot

Image 18

Initial Prediction: carousel	pixels_modified: 298	After Modification: water snake

Image 19

Initial Prediction: vase	pixels_modified: 557	After Modification: pot

Image 20

Initial Prediction: goose	pixels_modified: 255	After Modification: lakeside

Image 21

Initial Prediction: golden retriever	pixels_modified: 382	After Modification: tennis ball

Image 22

Initial Prediction: mountain tent	pixels_modified: 744	After Modification: valley

Image 23

Initial Prediction: seashore	pixels_modified: 185	After Modification: sandbar

Image 24

Initial Prediction: alp	pixels_modified: 486	After Modification: valley

Image 25

Initial Prediction: hamster	pixels_modified: 183	After Modification: bath towel

Image 26

Initial Prediction: alp	pixels_modified: 719	After Modification: ski

Image 27

Initial Prediction: jellyfish	pixels_modified: 254	After Modification: bubble

Image 28

Initial Prediction: gas pump	pixels_modified: 290	After Modification: traffic light

Image 29

Initial Prediction: promontory	pixels_modified: 177	After Modification: seashore

Image 30

Initial Prediction: coral reef	pixels_modified: 283	After Modification: scuba diver

Image 31

Initial Prediction: alp	pixels_modified: 536	After Modification: valley

Image 32

Initial Prediction: seashore	pixels_modified: 259	After Modification: lakeside

Image 33

Initial Prediction: Pembroke	pixels_modified: 773	After Modification: Cardigan

Image 34

Initial Prediction: Cardigan	pixels_modified: 290	After Modification: Pembroke

Image 35

Initial Prediction: alp	pixels_modified: 162	After Modification: volcano

Image 36

Initial Prediction: cocker spaniel	pixels_modified: 384	After Modification: Sussex spaniel

Image 37

Initial Prediction: sea lion	pixels_modified: 325	After Modification: otter

Image 38

Initial Prediction: pot	pixels_modified: 140	After Modification: spider web

Image 39

Initial Prediction: torch	pixels_modified: 153	After Modification: sleeping bag

Image 40

Initial Prediction: alp	pixels_modified: 279	After Modification: mountain tent

Image 41

Initial Prediction: seashore	pixels_modified: 289	After Modification: lakeside

Image 42

Initial Prediction: ox	pixels_modified: 883	After Modification: bison

Image 43

Initial Prediction: suspension bridge	pixels_modified: 166	After Modification: pier

Image 44

Initial Prediction: jellyfish	pixels_modified: 136	After Modification: sea slug

Image 45

Initial Prediction: volcano	pixels_modified: 487	After Modification: mountain tent

Image 46

Initial Prediction: goldfish	pixels_modified: 340	After Modification: anemone fish

Image 47

Initial Prediction: greenhouse	pixels_modified: 574	After Modification: folding chair

Image 48

Initial Prediction: greenhouse	pixels_modified: 340	After Modification: crutch

Image 49

Initial Prediction: valley	pixels_modified: 255	After Modification: fountain

Image 50

Initial Prediction: alp	pixels_modified: 983	After Modification: valley

Image 51

Initial Prediction: Indian elephant	pixels_modified: 644	After Modification: tusker

License

MIT