Determining scale and sea state from water video

In most image processing and computer vision applications, real-world scale can only be determined when calibration information is available. Dynamic scenes further complicate most situations. However, some types of dynamic scenes provide useful information that can be used to recover real-world scale. In this paper, we focus on ocean scenes and propose a method for finding sizes in real-world units and the sea state from an uncalibrated camera. Fourier transforms in the space and time dimensions yield spatial and temporal frequency spectra. For water waves, the dispersion relation defines a square relationship between the wavelength and period of a wave. Our method applies this dispersion relation to recover the real-world scale of an ocean sequence. The sea state-including the peak wavelength and period, the wind speed that generated the waves, and the wave heights-is also determined from the frequency spectrum of the sequence combined with stochastic oceanography models. The process is demonstrated on synthetic and real sequences, validating the results with known scene geometry. This has wide applications in port monitoring and coastal surveillance.