At Scale we built a tool for model debugging in computer vision called Nucleus (scale.com/nucleus) designed exactly for this, which is free try out if you're curious to see where your model predictions are most at odds with your ground truth. Source: over 2 years ago

To address your point about gathering edge cases, which can also be defined as cases of low model fidelity for our use cases, there is active learning and tools such as Aquarium Learning and Scale Nucleus which make it easy to implement into workflows. Source: almost 3 years ago

15Five | Remote: US, Poland, & Ukraine | Full-time | https://15five.com Multiple engineering and design roles, all fully remote: - Remote: Poland or Ukraine - Backend Engineer: https://jobs.lever.co/15five/bf43681a-74b7-493e-a8c8-9b568af10c04 - Remote: Poland or Ukraine - Android Mobile Engineer: https://jobs.lever.co/15five/9d42917c-c5ed-483e-b807-3243a3617377 - US-based only, remote - Senior Quality Assurance... - Source: Hacker News / about 3 years ago

At 15Five we migrated to Terraform in 8 months with a 3-person team. It went smoothly and gave us more confidence in our AWS infrastructure. When it came to setup a new VPC for a customer, the hours we invested returned to us in a speedy and simple setup, a process that would have been a massive pain if we had done it manually. - Source: dev.to / about 4 years ago