A new system for the real-time recognition of handwritten mathematical formulas

This paper presents a new system for the online and real-time recognition of handwritten mathematical formulas. Mathematical formulas are inputted into the system as hand drawings on a computer screen using a data tablet. The system analyzes the inputted data stroke by stroke in order to recognize the structure of the formula based on the relationship of bonding boxes that include components of the formula. A recognized result is obtained as a source code from the “LATEX” type serving system. Our system can recognize arbitrary combinations of superscripts, subscripts, square roots, overlines, underlines, and fractions. The input of the mathematical formula is independent of stroke order. In several experiments, the system proved to be very effective for inputting various mathematical formulas in real-time