At Scale we built a tool for model debugging in computer vision called Nucleus (scale.com/nucleus) designed exactly for this, which is free try out if you're curious to see where your model predictions are most at odds with your ground truth. Source: over 2 years ago

To address your point about gathering edge cases, which can also be defined as cases of low model fidelity for our use cases, there is active learning and tools such as Aquarium Learning and Scale Nucleus which make it easy to implement into workflows. Source: almost 3 years ago

Do fuzzy matching (something like fuzzywuzzy maybe) to see if the the words line up (allowing for wrong words). You'll need to work out how to use scoring to work out how well aligned the two lists are. Source: over 1 year ago

Convert the original lines to full furigana and do a fuzzy match. (For reference, the original line is 貴方がこれまでに得てきた力、存分に発揮してくださいね。) You can do a regional search using the initial scene data (E60) first, and if the confidence is low, go for a slower full search. Source: over 1 year ago

It's now known as "thefuzz", see https://github.com/seatgeek/fuzzywuzzy. Source: about 2 years ago

You can have a look at this library to use fuzzy search instead of looking for plaintext muck: https://github.com/seatgeek/fuzzywuzzy. Source: over 2 years ago

To deal with comparing the string, I found FuzzyWuzzy ratio function that is returning a score of how much the strings are similar from 0-100. Source: almost 3 years ago