We can compare discrete and continuous data by looking at how water comes out of a tap. A dripping tap shows discrete data, because each individual drop can be counted. The data collected will simply ...
At each sampling time instant, one observes system output and action to form discrete-time rewards. The sampled input-output data are collected along the trajectory of the dynamical system in ...