The Importance of Different Edge Types in Image Recognition

 
Which edges matter?
 
Aayush Bansal (CMU), Adarsh Kowdle (Microsoft), Devi Parikh (VT),
Andrew Gallagher (Cornell), Larry Zitnick (MSR)
 
Edge types
 
Edge types
 
Which are useful for recognition?
 
Roberts, 1965
 
Huttenlocher and Ullman, 1987
 
Jain and Farrokhnia, 1990
 
Kanade, 1981
 
Eitz etal., 2011
 
Cole etal., 2008
 
Can we isolate the effect of different
edge types?
 
Synthetic scenes
 
46 scenes, Google 3DWarehouse
 
Synthetic scenes
 
Black and white
 
Synthetic scenes
 
Albedo
 
Synthetic scenes
 
Gray surface
 
Synthetic scenes
 
Gray shaded
 
Synthetic scenes
 
Depth
 
Edges
 
RGB
 
Albedo
 
Gray surface
 
Gray shaded
 
Depth
 
Human studies
 
265 objects, 11 scene types, 10 subjects per test
 
Results
 
Results
 
What type of edges do our edge
detectors find?
 
Precision
 
Depth
 
Surface
normal
 
Shadow
 
Texture
 
Recall
 
Depth
 
Surface
normal
 
Shadow
 
Texture
 
Can we further improve our edge
detectors?
Contour detection
Parikh and Zitnick, CVPR 2012
Conclusion
Depth and surface normal edges are most
informative for recognition
Most automatic edge detectors find a significant
number of albedo and shadow edges
 
Better methods for evaluating edge detectors?
 
Are lines important or just edges?
Slide Note
Embed
Share

This content delves into the significance of various edge types in image recognition, exploring the impact of edges such as albedo, depth, surface normal, and shadow on the recognition process. Researchers have studied the effects of different edge types through works dating back to the 1960s, aiming to isolate their specific contributions. Synthetic scenes have been utilized to analyze edges' roles in different visual contexts, shedding light on their implications for image processing and scene understanding.

  • Image recognition
  • Edge types
  • Albedo
  • Depth
  • Synthetic scenes

Uploaded on Jul 19, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. Which edges matter? Aayush Bansal (CMU), Adarsh Kowdle (Microsoft), Devi Parikh (VT), Andrew Gallagher (Cornell), Larry Zitnick (MSR)

  2. Edge types

  3. Edge types Albedo Depth Surface normal Shadow

  4. Which are useful for recognition?

  5. Roberts, 1965

  6. Huttenlocher and Ullman, 1987

  7. Jain and Farrokhnia, 1990

  8. Kanade, 1981

  9. Eitz etal., 2011

  10. Cole etal., 2008

  11. Can we isolate the effect of different edge types?

  12. Synthetic scenes 46 scenes, Google 3DWarehouse

  13. Synthetic scenes Black and white

  14. Synthetic scenes Albedo

  15. Synthetic scenes Gray surface

  16. Synthetic scenes Gray shaded

  17. Synthetic scenes Depth

  18. Edges RGB Albedo Depth Gray surface Gray shaded

  19. Human studies 265 objects, 11 scene types, 10 subjects per test

  20. Results

  21. Results

  22. What type of edges do our edge detectors find?

  23. Precision Depth Surface normal Shadow Texture

  24. Recall Depth Surface normal Shadow Texture

  25. Can we further improve our edge detectors?

  26. Contour detection Parikh and Zitnick, CVPR 2012

  27. Conclusion Depth and surface normal edges are most informative for recognition Most automatic edge detectors find a significant number of albedo and shadow edges Better methods for evaluating edge detectors? Are lines important or just edges?

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#