We have discussed how to fit polynomials to windows of images. The next step is to check if any of the level sets of the polynomial correspond to actual boundary curves in the image window.
The process can be repeated for several polynomial degrees and the lowest degree meeting some criterion chosen.