Wiener\u2019s definition involves two essential conceptual binomials. The first is control-communication<\/em>: the need for sufficient and quality information about a system\u2019s state to make the right decisions, reach a given objective, or avoid risky regimes. The second binomial is animal-machine<\/em>. As Aristotle predicted, human beings rationally aim to build machines that perform tasks that would otherwise prevent them from dedicating time and energy to more significant activities. The close link between control and\/or cybernetics and ML is thus built into Wiener\u2019s own definition.<\/p>\n The interconnections between different mathematical disciplines are split by conceptual and technical mountain ranges and have often evolved in different communities. As such, they are frequently hard to observe. Building the connecting paths and identifying the hypothetical mountain passes requires an important level of abstraction. Let us take a step back and consider a wider perspective.<\/p>\n <\/p>\n <\/p>\n The notion of controllability <\/em>helps us disclose one of the gateways between disciplines. Controllability involves driving a dynamical system from an initial configuration to a final one within a given time horizon via skillfully designed and viable controls. In the framework of linear finite N<\/em>-dimensional systems<\/p>\n \u00a0<\/em>x<\/em>\u2032+Ax<\/em>=Bu<\/em>,<\/strong><\/p>\n the answer is elementary and classical (it dates back to Rudolf Kalman<\/a><\/strong>\u2019s work in the 1950s, at least) [6]. The system is controllable if and only if the matrix A<\/em> that governs the system\u2019s dynamics and the matrix B<\/em> that describes the controls\u2019 effects on the state\u2019s different components verify the celebrated rank condition<\/p>\n rank[B<\/em>,AB<\/em>,…AN<\/em>\u22121B<\/em>]=N<\/em>.<\/strong><\/p>\n The control\u2019s size naturally depends on the length of the time horizon; it must be enormous for very short time horizons and can have a smaller amplitude for longer ones.<\/p>\n In fact, as John von Neumann<\/a><\/strong> anticipated and Nobel Prize-winning economist Paul Samuelson<\/a><\/strong> further analyzed, the \u201cturnpike\u201d property manifests itself over long time horizons; controls tend to spend most of their time in the optimal steady-state configuration [5]. We apply this lesser-known principle systematically (and often unconsciously) in our daily lives. When travelling to work, for instance, we may rush to the station to take the train\u2014our turnpike in this ride\u2014on which we then wait to reach our final destination. Medical therapies for chronic diseases also utilize this principle; physicians may instruct patients to take one pill\u00a0a day after breakfast, rather than follow a sharper but much more complicated dosage. This property even arises in the field of economics when national banks set interest rates in six-month horizons and only revisit the policies to adjust for newly emerging macroeconomic scenarios.<\/p>\n Are these ideas and methods at all relevant to ML?<\/p>\n (…)<\/p>\n![\"\"](\"https:\/\/cmc.deusto.eus\/enzuazua\/wp-content\/uploads\/2022\/10\/cyber.jpg\")
Control theory certainly lies at the pedestal of ML. Aristotle<\/a><\/strong> anticipated control theory when he described the need for automated processes to free human beings from their heaviest tasks [3]. In the 1940s, mathematician and philosopher Norbert Wiener<\/a><\/strong> redefined the term \u201ccybernetics\u201d\u2014which was previously coined by Andr\u00e9-Marie Amp\u00e8re<\/a><\/strong>\u2014as \u201cthe science of communication and control in animals and machines,\u201d which reflected the discipline\u2019s definitive contribution to the industrial revolution.<\/p>\n![\"\"](\"https:\/\/cmc.deusto.eus\/enzuazua\/wp-content\/uploads\/2022\/10\/Figura-1_ok.jpg\")
<\/p>\nFigure 1.<\/strong> Simultaneous control of trajectories of a neural ordinary differential equation (NODE) for classification according to two different labels (blue\/red), exhibiting the turnpike nature of trajectories. Figure courtesy of [5].<\/h6>\n