BMW Group expands activities in China
US Senate Armed Services Committee produces markup limiting DoD purchase of biofuels and prohibiting construction of biorefineries

Oak Ridge researcher developing autonomous intelligent engines capable of real-time calibration based on driver behavior

Improvement in fuel consumption (red line) from one of the case models using the POD learning model. Source: Malikopoulos 2010. Click to enlarge.

Dr. Andreas Malikopoulos at Oak Ridge National Laboratory is leading an effort to enable an automobile engine to function as an autonomous intelligent system capable of learning and realizing its optimal calibration in real-time under different conditions while the driver is driving. (Calibration is defined as the procedure required to optimize one or more engine performance indices—such as fuel economy, emissions, or engine power—with respect to the engine controllable variables.)

Equipped with this capability, an engine should be able personalize its calibration for each driver—i.e., progressively to perceive a driver’s unique driving style and then to optimize one or more engine performance indices for that style. Malikopoulos has run a number of simulation studies (using the enDYNA high fidelity simulation model) showing up to 10% fuel economy improvement using his proposed method compared to a standard baseline engine.

The ultimate goal, he says, is to exploit fully existing propulsion technologies in terms of fuel economy and pollutant emissions. His body of work on on the underlying the theory and algorithms for this this extends back several years to his 2008 doctoral thesis at the University of Michigan (subsequently published as a book: Real-time, self-learning identification and stochastic optimal control of advanced powertrain systems).

Malikopoulos has recently begun a DOE-funded project on developing autonomous intelligent plug-in hybrid electric vehicles (PHEVs); he presented an early update at the recent DOE 2012 Annual Merit Review meetings in Washington, DC. The objective of this project is to use the control algorithms to operate a PHEV at an instantaneous equilibrium operating point, assuring maximization of the efficiency of the PHEV at each instant of time.

Background. Current approaches to engine optimization and control generally establish static correlations between the variables and steady-state operating points or specific driving conditions (e.g., vehicle speed profiles for highway and city driving). These correlations are incorporated into the engine’s electronic control unit (ECU). However, notes Malikopoulos, this method seldom guarantees optimal engine operation for common driving habits such as stop-and-go driving, rapid acceleration, or rapid braking—i.e., transient operation.

Malikopoulos’ underlying hypothesis is that transient engine operation can be addressed by estimating the sequences of engine operating point transitions designated by the driver, and then deriving the values of the controllable variables for these sequences.

Malikopoulos treats the engine as a controlled stochastic system and the engine operation as a Markov decision process. The problem of engine calibration is thus reformulated as a sequential decision-making problem under uncertainty.

Engines are streamlined syntheses of complex physical processes determining a convoluted dynamic system. They are operated with reference to engine operating points and the values of various engine controllable variables. At each operating point, these values highly influence engine performance criteria, e.g., fuel economy, emissions, or acceleration. This influence becomes more important at engine operating point transitions designated partly by the driver’s driving style and partly by the engine controllable variables. Consequently, the engine is a system whose behavior is not completely foreseeable, and its future evolution (operating point transitions) depends on the driver’s driving style.

Transient operation constitutes the largest segment of engine operation over a driving cycle compared with the steady-state one...the optimal values of the controllable variables corresponding to steady-state operating points cannot capture efficiently the transient engine operation.

Engine operation is described in terms of its operating points, and the evaluation of performance indices is a function of various controllable variables. Here, the engine performance indices are treated as random functions, the engine is treated as a controlled stochastic system, and the engine operation is treated as a stochastic process. Engine calibration is thus reformulated as a sequential decision-making problem under uncertainty. The goal is to select values of the controllable variables for each engine operating point in real time that optimize the random functions (engine performance indices).

The Markov decision process (MDP) provides the mathematical framework for modeling sequential decision-making problems under uncertainty; it comprises (a) a decision maker (controller), (b) states (engine operating points), (c) control actions (engine controllable variables), (d) a transition probability matrix (driver), (e) a transition cost (or reward) matrix (engine performance criteria), and (f) an optimization criterion (e.g., maximizing fuel economy, minimizing pollutant emissions, and maximizing engine acceleration).

—Malikopoulos et al. (2010)

To validate the Predictive Optimal Decision-making (POD) computational learning model, Malikopoulos and his colleagues have modeled various case studies including:

  • Gasoline engine with respect to spark ignition angle over aggressive acceleration profiles.

  • Diesel engine with respect to injection timing over an acceleration and deceleration profile.

  • Diesel engine with respect to injection timing and VGT over a segment of the FTP-75 driving cycle.


  • Malikopoulos, Andreas A. Real-time, self-learning identification and stochastic optimal control of advanced powertrain systems; ProQuest, UMI Dissertation Publishing (September 2, 2011)

  • Malikopoulos, Andreas A., Papalambros, Panos Y. and Assanis, Dennis N. (2010) Online Identification and Stochastic Control for Autonomous Internal Combustion Engines. J. Dyn. Sys., Meas., Control 132, 024504 doi: 10.1115/1.4000819

  • Malikopoulos, A.A. (2012) Autonomous Intelligent Plug-In Hybrid Electric Vehicles (PHEVs) (DOE AMR VSS092)

  • Malikopoulos, A.A., Charalambous, C.D. and Tzortzis, I., “Dual Constrained Optimization of Markov Chains Subject to Total Variation Distance Uncertainty,” Proceedings of the 51th IEEE Conference on Decision and Control and European Control Conference, Maui, Hawaii, December 10-13, 2012. (in review)



Seems to be an easy way to improve efficiency, if drivers (negative) interference could be managed.


Transients have long been the headache for emissions management also.

Batteries are good at buffering short-term power transients.  This is one reason why the CARB ZEV mandate was so wrong-headed; by granting no credit to PHEVs, it didn't allow the use of battery banks to allow a sustainer engine to be operated at constant or slowly-varying power levels.  This would have both increased efficiency and cut emissions more than the technologies which actually reached the market.

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.


Post a comment

Your Information

(Name is required. Email address will not be displayed with the comment.)