Welcome to Prof.CAO's website

1. Discrete Event Dynamic Systems, Perturbation Analysis; 2. Communications; 3. Signal Process; 4. OR & AP Optimization; 5. Game Theory & Application; 6. Surveys and Tutorials; 7. Others; 8. Conference

1. Discrete Event Dynamic Systems, Perturbation Analysis

De-Xin Wang, Xi-Ren Cao, and Li Qiu, Completion-of-Squares: Revisited and Extended, Systems and Control Letters, to appear.
Li Xia and Xi-Ren Cao, Performance optimization of queueing systems with perturbation realization, European Journal of Operations Research, invited review, to appear.
Yan-Kai Xu and Xi-Ren Cao, Lebesgue-Sampling-Based Optimal Control Problems With Time Aggregation, IEEE Transactions on Automatic Control, Vol. 56, 1097-1109, 2011.
Xi-Ren Cao, De-Xin Wang, T. Lu, and Y. F. Xu. Stochastic Control via Direct Comparison, Discrete Event Dynamic Systems: Theory and Applications, Vol. 21, 11-38, 2011.
Yanjie Li, Fang Cao and Xi-Ren Cao, On-Line Policy Gradient Estimation with Multi-Step Sampling, Discrete Event Dynamic Systems: Theory and Applications, Vol. 20, 3-17, 2010.
Xi-Ren Cao, Stochastic Learning and Optimization - A Sensitivity-Based Approach, (IFAC) Annual Review in Control, invited review, Volume 33, 11-24, 2009.
Junyu Zhang and Xi-Ren Cao, Continuous-Time Markov Decision Processes with nth-Bias Optimality Criteria, Automatica, Vol. 45 1628-1638, 2009.
Li Xia, Xi Chen, and Xi-Ren Cao, Policy Iteration of Customer-Average Performance in Queueing Systems, Automatica, Vol. 45, 1639-1648, 2009.
Xi-Ren Cao and Junyu Zhang, Event-Based Optimization of Markov Systems, IEEE Transactions on Automatic Control, Vol. 53, 1076-1082, 2008.
Xi-Ren Cao and Junyu Zhang, The nth-Order Bias Optimality for Multi-chain Markov Decision Processes, IEEE Transactions on Automatic Control, Vol. 53, 496-508, 2008.
Kan-Jian Zhang, Yan-Kai Xu, Xi Chen and Xi-Ren Cao, Policy Iteration Based Feedback Control, Automatica, Vol. 44, pp. 1055-1061, 2008.
Xi-Ren Cao and Xianping Guo, Partially Observable Markov Decision Processes with Reward Information: Basic Ideas and Models, IEEE Transactions on Automatic Control, Vol. 52, Issue 4, April, 2007.
Xi-Ren Cao and Junyu Zhang, Discussion on A Survey of Recent Results on Continuous-Time Markov Decision Processes, TOP, Invited paper, Vol. 14, pp. 241-245, 2006.
Xia Li and Xi-Ren Cao, Relationship Between Perturbation Realization Factors with Queueing Models and Markov Models, IEEE Transactions on Automatic Control, Vol. 51, Issue 10, pp. 1699-1704, October, 2006.
Yat-wah Wan and Xi-Ren Cao, "The Control of a Two-Level Markov Decision Process by Time Aggregation", Automatica, Vol. 42, pp. 393-403, 2006.
Xi-Ren Cao, "A Basic Formula for Online Policy Gradient Algorithms", IEEE Transactions on Automatic Control, Vol. 50, No. 5, May 2005.
Xianping Guo and Xi-Ren Cao, "Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards", SIAM Journal on Control and Optimization, Vol. 44, No. 1, pp. 29-48, 2005.
Xi-Ren Cao, "Basic Ideas for Event-Based Optimization of Markov Systems", Discrete Event Dynamic Systems: Theory and Applications, Vol. 15, pp. 169-197, 2005.
Xi-Ren Cao, "The Potential Structure of Sample Paths and Performance Sensitivities of Markov Systems", IEEE Transactions on Automatic Control, Vol. 49, No. 12, pp. 2129-2142, December 2004.
Xi-Ren and Xianping Guo, "A unified approach to Markov decision problems and performance sensitivity analysis with discounted and average criteria: multichain cases", Automatica, 40, pp. 1749-1759, 2004.
Hai-Tao Fang and Xi-Ren Cao, "Potential-Based On-line Policy Iteration Algorithms for Markov Decision Processes", IEEE Transactions on Automatic Control, Vol. 49, 493-505, 2004.
Xi-Ren Cao, "Introduction to the Special Issue on Learning, Optimization, and Decision Making in DEDS", Discrete Event Dynamic Systems: Theory and Applications, 13, 7-8, 2003.
Xi-Ren Cao, "Semi-Markov Decision Problems and Performance Sensitivity Analysis", IEEE Transactions on Automatic Control, Vol. 48, No. 5, pp. 758-769, 2003.
Xi-Ren Cao, "From Perturbation Analysis to Markov Decision Processes and Reinforcement Learning ", Discrete Event Dynamic Systems: Theory and Applications, Vol. 13, pp. 9-39, 2003.
Bernd Heidergott and Xi-Ren Cao, "A Note on the Relation Between Weak Derivatives and Perturbation Realization", IEEE Transactions on Automatic Control, Vol. 47, No. 7, July 2002.
R. Boel, Xi-Ren Cao, G. Cohen, A. Giua, W. M. Wonham, J. H. Van Schuppen, "Unity in Diversity, Diversity in Unity: Retrospective and Prospective Views on Control of Discrete Event Systems", Discrete Event Dynamic Systems: Theory and Applications, Vol. 12, pp. 253-264, 2002.
Xi-Ren Cao, Z.Y. Ren, Shalabh Bhatnagar, Michael Fu, and Steven Marcus, "A Time Aggregation Approach to Markov Decision Processes", Automatica, Vol. 38, pp. 929-943, 2002.
Xi-Ren Cao, "A Sensitivity View of Markov Decision Processes and Reinforcement Learning", Book Chapter 11 of Modeling, Control and Optimization of Complex Systems, edited by Weibo Gong and Leyuan Shi, Kluwer Academic Publishers, June 2001.
Hai-Tao Fang, Han-Fu Chen, and Xi-Ren Cao, "Recursive Approaches for Single Sample Path Based Markov Reward Processes", Asian Journal of Control, Vol. 3, No. 1, pp. 21-26, 2001.
Xi-Ren Cao, "A Unified Approach to Markov Decision Problems and Performance Sensitivity Analysis", Automatica, Vol. 36, pp. 771-774, 2000.
Xi-Ren Cao, Michael C. Fu, and J. -Q. Hu, "On Performance Potential and Conditional Monte Carlo for Gradient Estimation for Markov Chains", Annals of Operations Research, Vol. 87, pp. 263-272, 1999.
Xi-Ren Cao, "Single Sample Path Based Optimization of Markov Chains", Journal of Optimization: Theory and Application, Vol. 100, No. 3, pp. 527-548, 1999.
Xi-Ren Cao, "The Maclaurin Series for Performance Functions of Markov Chains", Advances in Applied Probability, Vol. 30, pp. 676-692, 1998.
Xi-Ren Cao, "The Relation Among Potentials, Perturbation Analysis, and Markov Decision Processes", Journal of Discrete Event Dynamic Systems, Vol. 8, pp. 71-87, 1998.
Xi-Ren Cao and Yat-wah Wan, "Algorithms for Sensitivity Analysis of Markov Systems through Potentials and Perturbation Realization", IEEE Transactions on Control Systems Technology, Vol. 6, pp. 482-494, 1998.
Xi-Ren Cao and Han-Fu Chen, "Perturbation Realization, Potentials, and Sensitivity Analysis of Markov Processes", IEEE Transactions on Automatic Control, Vol. 42, pp. 1382-1393, 1997.
Xi-Ren Cao, X. M. Yuan, and L. Qiu, "A Single Sample Path-Based Performance Sensitivity Formula for Markov Chains", IEEE Transactions on Automatic Control, Vol. 41, pp. 1814-1817, 1996.
Xi-Ren Cao, "Ensemble-Average Importance Sampling of Markov Processes", International Journal in Computer Simulation, Vol. 6, pp. 489-512, 1996.
Xi-Ren Cao and D. J. Ma, "Performance Sensitivity Formulas, Algorithms, and Estimates for Closed Queueing Networks with Exponential Servers", Performance Evaluation, Vol. 26, pp. 181-199, 1996.
Xi-Ren Cao, "Uniformization and Performance Sensitivity Estimation in Closed Queueing Networks", Mathematical and Computer Modeling, (invited paper) Vol. 23, No 11/12, pp. 77-92, 1996.
Xi-Ren Cao, "Event Coupling and Performance Sensitivity Analysis of Generalized Semi-Markov Processes", Advances in Applied Probability, pp. 741-769, 1995.
Xi-Ren Cao, W. G. Gong, and Y. Wardi, "Ill-Conditioned Performance Functions of Queueing Systems", IEEE Transactions on Automatic Control, Vol. 40, pp. 1074-7079, 1995.
Xi-Ren Cao, "State Aggregation and Discrete-State Markov Chains Embedded in a Class of Point Processes", Journal of Applied Probability, Vol. 32, pp. 39-51, 1995.
Xi-Ren Cao, "Performance Sensitivity Analysis of Open Markovian Queueing Networks", European Journal of Operational Research, Vol. 76, pp.529-551, 1994.
D. J. Ma and Xi-Ren Cao, "Realization Factors and Decentralized Optimization of Jackson Networks", Journal of Engineering, Taiwan, No. 5, pp. 87-98, 1994.
D. J. Ma and Xi-Ren Cao, "A Direct Approach to Decentralized Control of Service Rates in a Closed Jackson Network", IEEE Transactions on Automatic Control", Vol. 39, pp. 1460-1463, 1994.
Xi-Ren Cao, "A New Method of Performance Sensitivity Analysis for non-Markovian Queueing Networks", Queueing Systems: Theory and Applications, Vol. 10, pp. 313-350, 1992.
Xi-Ren Cao, "A Linear Algebraic Formulation of the Performance Sensitivities of Queueing Networks", European Journal of Operational Research, Vol. 56, pp. 394-406, 1992.
Xi-Ren Cao and D. J. Ma, New Performance Sensitivity Formulae for a Class of Product-Form Queueing Networks, Journal of Discrete Event Dynamic Systems, Vol. 1, pp. 289-313, 1992.
Xi-Ren Cao, "Perturbation Analysis of Closed Queueing Networks with General Service Time Distributions", IEEE Transactions on Automatic Control, Vol. 36, pp. 1327-1330, 1991.
Xi-Ren Cao, "Some New Results on Realization Probability" (Addendum to "A Comparison of the Dynamics of Continuous and Discrete Event Systems"), Discrete Event Dynamic Systems: Analyzing Complexity and Performance in the Modern World, edited by Y. C. Ho, pp. 9-10, IEEE Press, 1991.
Xi-Ren Cao and D. J. Ma, "Sensitivity Analysis of General Performance Measures of Queueing Networks with State Dependent Service Rates", Applied Mathematics Letters, Vol. 4, pp. 57-60, 1991.
Xi-Ren Cao, "Realization Factors and Sensitivity Analysis of Queueing Networks with State Dependent Service Rates", Advances in Applied Probability, Vol. 22, pp. 178-210, 1990.
Xi-Ren Cao, "The Convergence Property of Sample Derivatives in Closed Jackson Queuing Networks", Stochastic Processes and their Applications, Vol. 33, pp. 105-122, 1989.
Xi-Ren Cao, "Estimates of Performance Sensitivity of a Stochastic System", IEEE Transactions on Information Theory, Vol. 35, pp. 1058-1068, 1989.
Xi-Ren Cao, "The Predictability of Discrete Event Systems", IEEE Transactions on Automatic Control, Vol. 34, pp. 1168-1171, 1989.
Xi-Ren Cao, "A Comparison of the Dynamics of Continuous and Discrete Event Systems", IEEE Proceedings, Vol. 77, pp. 7-13, 1989.
Xi-Ren Cao, "Realization Probability and Throughput Sensitivity in a Closed Jackson Network", Journal of Applied Probability, Vol. 26, pp. 615-624, 1989.
Xi-Ren Cao, "Calculation of Sensitivities of Throughputs and Realization Probabilities in Closed Queueing Networks with Finite Buffers", Advances in Applied Probability, Vol. 21, pp. 181-206, 1989.
Xi-Ren Cao, "System Representations and Performance Sensitivity Estimates of Discrete Event Systems", Mathematics and Computers in Simulation, Vol. 31, pp. 113-122, 1989.
Xi-Ren Cao, "The Static Property of a Perturbed Multiclass Closed Queueing Network and Decomposition", IEEE Transactions on Automatic Control, Vol. 34, pp. 246-249, 1989.
P. Heidelberger, Xi-Ren Cao, M. Zazanis, and R. Suri, "Convergence Properties of Infinitesimal Perturbation Analysis Estimates", Management Science, Vol. 34, No. 11, pp. 1281-1302, 1988.
Xi-Ren Cao, "Realization Probability in Multi-Class Closed Queuing Networks", European Journal of Operational Research, Vol. 36, pp. 393-401, 1988.
Xi-Ren Cao, "On a Sample Performance Function of Jackson Queueing Networks", Operations Research, Vol. 36, No. 1, pp. 128-136, 1988.
Xi-Ren Cao, "Feedback Invariant Discipline and Insensitivity in Closed Queueing Networks", Systems and Control Letters, Vol. 9, pp. 349-353, 1987.
Xi-Ren Cao and Y. C. Ho, "Sensitivity Estimate and Optimization of Throughput in a Production Line with Blocking", IEEE Transactions on Automatic Control, Vol. 32, pp. 959-967, 1987.
Xi-Ren Cao, "Realization Probability in Closed Jackson Queueing Networks and Its Application", Advances in Applied Probability, Vol. 19, pp. 708-738, 1987.
Xi-Ren Cao and Y. C. Ho, "Estimating Sojourn Time Sensitivity in Queueing Networks Using Perturbation Analysis", Journal of Optimization Theory and Applications, Vol. 53, No. 3, pp. 353-375, 1987.
Xi-Ren Cao, "Sensitivity Estimates Based on One Realization of a Stochastic System", Journal of Statistical Computation and Simulation, Vol. 27, p. 211-232, 1987.
Xi-Ren Cao, "First-Order Perturbation Analysis of a Single Multi-Class Finite Source Queue", Performance Evaluation, Vol. 7, pp. 31-41, 1987.
Xi-Ren Cao and Yves Dallery, "An Operational Approach to Perturbation Analysis of Closed Queueing Networks", Mathematics and Computers in Simulation, Vol. 28, pp. 433-451, 1986.
Y. C. Ho and Xi-Ren Cao, "Performance Sensitivity to Routing Changes in Queueing Networks and Flexible Manufacturing Systems Using Perturbation Analysis", IEEE Journal of Robotics and Automation", Vol. RA-1, No. 4, pp. 165-172, December, 1985.
Xi-Ren Cao, "Convergence of Parameter Sensitivity Estimates in a Stochastic Experiment", IEEE Transactions on Automatic Control, Vol. AC- 30, pp. 834-843, 1985.
Y. C. Ho, R. Suri, Xi-Ren Cao, and et al., "Optimization of Large Multiclass (Non-product Form) Queueing Networks Using Perturbation Analysis", Large Scale Systems, Vol. 7, pp. 165-180, 1984.
Y. C. Ho, Xi-Ren Cao, and C. Cassandras, "Infinitesimal and Finite Perturbation Analysis for Queueing Networks", Automatica, 1984, pp. 439-445, 1983.
R. Suri and Xi-Ren Cao, "The Phantom Customer and Marked Customer Methods for Optimization of Closed Queueing Networks with Blocking and General Service Times", ACM Performance Evaluation Review, pp. 243-256, August 1983.
Y. C. Ho and Xi-Ren Cao, "Perturbation Analysis and Optimization of Queueing Networks", Journal of Optimization Theory and Applications, Vol. 40, No. 4, pp. 559-582, 1983.

Back to list

2. Communications

Xi-Ren Cao and Junjie Wang, "Obtaining Packet Response Times for Nonblocking ATM Switches", Performance Evaluation, Volume 51, Issue 1, January 2003, Pages 33-45.
Bo Li, Yang Qin, Xi-Ren Cao, and K. M. Sivalingam, "Simple Models for Computing Throughput of Photonic Switches", Photonic Network Communications, to appear.
Bin Li, Lizhong Li, Bo Li, and Xi-Ren Cao, "On Handoff Performance for an Integrated Voice/Data Cellular System ACM Wireless Networks (WINET)", Wireless Networks, 9, pp. 393-402, 2003.
Xi-Ren Cao, Hong-Xia Shen, Rodolfo Milito, and Patrica Wirth, "Internet Pricing With a Game Theoretical Approach: Concepts and Examples", IEEE/ACM Transactions on Networking, Vol. 10, No. 2, April 2002.
Xi-Ren Cao, Hongxia Shen, Rodolfo Milito, and Patrica Wirth, "Internet Pricing With a Game Theoretical Approach: Concepts and Examples", IEEE/ACM Transactions on Networking, Vol. 10, pp. 208-216, 2002.
Xi-Ren Cao, Junjie Wang, and Chin-Tau Lea, "Computing MDP Cost Function for High Speed Networks with Sample-Path and Quantization, Communications in Information and Systems, Vol. 1, pp. 147-162, 2001.
Bo Li, Yang Qin, Xi-Ren Cao, and Krishna M. Sivalingam, "Photonic Packet Switchings: Architecture and Performance", SPIE Optical Networks, Vol. 2, No. 1, pp. 27-39, Jan/Feb 2001.
Bo Li, Mounir Hamdi, Y. T. Hou, Dongyi Jiang, and Xi-Ren Cao, "QoS Enabled Voice Support in the Next Generation Internet: Issues, Existing Approaches and Challenges", IEEE Communications Magazine, Vol. 38, pp. 54-61, 2000.
Jie Zhu, Xi-Ren Cao, and R. -W. Liu, "A Blind Fractionally-Spaced Equalizer Using Higher Order Statistics ", IEEE Transactions on Circuits and Systems, Vol. 46, No. 6, pp. 755-764, 1999.
Jie Zhu, Zhi Ding, and Xi-Ren Cao, "Column-Anchored Zeroforcing Blind Equalization for Multiuser Wireless FIR Channels", IEEE Journal on Selected Areas of Communications, Vol. 17, pp. 411-423, 1999.
Dennis P. C. Iun and Xi-Ren Cao, "Performance Analysis of a Nonblocking ATM Switch with a Bufferless Internal Speedup Fabric", Computer Networks and ISDN Systems, Vol. 30, pp. 2337-2347, 1998.
Xi-Ren Cao and Don Towsley, "A Performance Model for ATM Switches with General Packet Length Distributions", IEEE/ACM Transactions on Networking, Vol. 3, pp. 299-309, 1995.
Xi-Ren Cao, "The Maximum Throughput of a Non-Blocking Space-Division Packet Switch with Correlated Destinations", IEEE Transactions on Communications", Vol. 43, pp. 1898-1901, 1995.
Xi-Ren Cao, "Some Common Misconceptions About Performance Modeling and Validation", ACM Performance Evaluation Review, Vol. 21, No. 2, pp. 11-15, 1993.
V. Abidi, D. J. Ma, and Xi-Ren Cao, "Performance of the FDDI-based Vaxcluster Systems", Vaxcluster Systems Quorum, Vol. 7, Issue 3, pp. 48-88, 1992.
Xi-Ren Cao, Nii Quaynor, and Fernando Colon Osorio, "CI Bus Arbitration Performance Study", Digital Technical Journal, No.5, pp. 93-103, 1987.
Xi-Ren Cao, "First-Order Perturbation Analysis of a Single Multi-Class Finite Source Queue", Performance Evaluation, Vol. 7, pp. 31-41, 1987.

Back to list

3. Signal Process

Guoxiang Gu, Xi-Ren Cao, Hesham Badr, Generalized LQR Control and Kalman Filtering with Relations to Computation of Inner-outer and Spectral Factorizations, IEEE Transactions on Automatic Control, Vol. 51, pp. 595-605, April, 2006.
Han-Fu Chen, Xi-Ren Cao, Hai-Tao Fang, and Jie Zhu, "Nonlinear Adaptive Blind Whitening for MIMO Channels", IEEE Transactions on Signal Processing, Vol. 53, No. 8, August 2005.
Xi-Ren Cao and Bing Zeng, "Structure and Inerpretation of Signals and Systems", IEEE Transactions on Automatic Control, Vol. 48, No. 9, September 2003.
Han-Fu Chen, Xi-Ren Cao, and Jie Zhu, "Convergence of a Stochastic-Approximation-Based Algorithm for Blind Channel Identification", IEEE Transactions on Information Theory, Vol. 48, pp. 1214-1225, 2002.
Jie Zhu, Xi-Ren Cao, and R. -W. Liu, "A Blind Fractionally-Spaced Equalizer with Joint Matrix Diagonalization", IEEE Transactions on Circuits and Systems, Vol. 46, pp. 755-764, 1999.
Jie Zhu, Xi-Ren Cao, and Zhi Ding, "An Algebraic Principle for Blind Separation of White non-Gaussian Sources", Signal Processing, Vol. 76, pp. 105-115, 1999.
Jie Zhu, Zhi Ding, and Xi-Ren Cao, "Column-Anchored Zeroforcing Blind Equalization for Multiuser Wireless FIR Channels", IEEE Journal on Selected Areas of Communications, Vol. 17, pp. 411-423, 1999.
Xi-Ren Cao and R. -W. Liu, "General Approach to Blind Signal Separation", IEEE Transactions on Signal Processing, Vol. 44, pp. 562-571, 1996.
Xi-Ren Cao, "Estimates of Performance Sensitivity of a Stochastic System", IEEE Transactions on Information Theory, Vol. 35, pp. 1058-1068, 1989.

Back to list

4. OR & AP Optimization

Kan-Jian Zhang, Yan-Kai Xu, Xi Chen and Xi-Ren Cao, Policy Iteration Based Feedback Control, Automatica, Vol. 44, pp. 1055-1061, 2008.
Xi-Ren Cao and Junyu Zhang, "The nth-Order Bias Optimality for Multi-chain Markov Decision Processes", IEEE Trans. Autom. Control, vol. 53, no. 2, pp. 496?C508, Mar. 2008.
Xi-Ren Cao and Xianping Guo, Partially Observable Markov Decision Processes with Reward Information: Basic Ideas and Models, IEEE Transactions on Automatic Control, Vol. 52, Issue 4, April, 2007.
Xi-Ren Cao and Junyu Zhang, Discussion on A Survey of Recent Results on Continuous-Time Markov Decision Processes, TOP, Invited paper, Vol. 14, pp. 241-245, 2006.
Xia Li and Xi-Ren Cao, Relationship Between Perturbation Realization Factors with Queueing Models and Markov Models, IEEE Transactions on Automatic Control, Vol. 51, Issue 10, pp. 1699-1704, October, 2006.
Ji-An Zhao, Bo Li, Xi-Ren Cao and Ishfaq Ahmad, "A Matrix-Analytic Solution for the DBM AP/PH/1 Priority Queue", Queueing Systems: Theory and Applications, Vol. 53, pp. 127-145, 2006.
Yat-wah Wan and Xi-Ren Cao, "The Control of a Two-Level Markov Decision Process by Time Aggregation", Automatica, Vol. 42, pp. 393-403, 2006.
Xi-Ren Cao, "A Basic Formula for Online Policy Gradient Algorithms", IEEE Transactions on Automatic Control, Vol. 50, No. 5, May 2005.
Xianping Guo and Xi-Ren Cao, "Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards", SIAM Journal on Control and Optimization, Vol. 44, No. 1, pp. 29-48, 2005.
Xi-Ren Cao, "Basic Ideas for Event-Based Optimization of Markov Systems", Discrete Event Dynamic Systems: Theory and Applications, Vol. 15, pp. 169-197, 2005.
Xi-Ren Cao, "The Potential Structure of Sample Paths and Performance Sensitivities of Markov Systems", IEEE Transactions on Automatic Control, Vol. 49, No. 12, pp. 2129-2142, December 2004.
Xi-Ren and Xianping Guo, "A unified approach to Markov decision problems and performance sensitivity analysis with discounted and average criteria: multichain cases", Automatica, 40, pp. 1749-1759, 2004.
Xi-Ren Cao, "Single Sample Path Based Optimization of Markov Chains", Journal of Optimization: Theory and Application, Vol. 100, No. 3, pp. 527-548, 1999.
Xi-Ren Cao, "The Maclaurin Series for Performance Functions of Markov Chains", Advances in Applied Probability, Vol. 30, pp. 676-692, 1998.
Xi-Ren Cao, "The Relation Among Potentials, Perturbation Analysis, and Markov Decision Processes", Journal of Discrete Event Dynamic Systems, Vol. 8, pp. 71-87, 1998.
Xi-Ren Cao and Yat-wah Wan, "Algorithms for Sensitivity Analysis of Markov Systems through Potentials and Perturbation Realization", IEEE Transactions on Control Systems Technology, Vol. 6, pp. 482-494, 1998.
Xi-Ren Cao, "Ensemble-Average Importance Sampling of Markov Processes", International Journal in Computer Simulation, Vol. 6, pp. 489-512, 1996.
Xi-Ren Cao, "Event Coupling and Performance Sensitivity Analysis of Generalized Semi-Markov Processes", Advances in Applied Probability, pp. 741-769, 1995.
Xi-Ren Cao, "State Aggregation and Discrete-State Markov Chains Embedded in a Class of Point Processes", Journal of Applied Probability, Vol. 32, pp. 39-51, 1995.
Xi-Ren Cao, "Decomposition of Random Variables with Bounded Hazard Rates", Operations Research Letters, Vol. 13, pp. 113-120, 1993.
Yves Dallery and Xi-Ren Cao, "Operational Analysis of Stochastic Closed Queueing Networks", Performance Evaluation, Vol. 14, pp. 43-61, 1992.
Xi-Ren Cao, "Realization Factors and Sensitivity Analysis of Queueing Networks with State Dependent Service Rates", Advances in Applied Probability, Vol. 22, pp. 178-210, 1990.
Xi-Ren Cao, "The Convergence Property of Sample Derivatives in Closed Jackson Queuing Networks", Stochastic Processes and their Applications, Vol. 33, pp. 105-122, 1989.
Xi-Ren Cao, "Realization Probability and Throughput Sensitivity in a Closed Jackson Network", Journal of Applied Probability, Vol. 26, pp. 615-624, 1989.
Xi-Ren Cao, "Calculation of Sensitivities of Throughputs and Realization Probabilities in Closed Queueing Networks with Finite Buffers", Advances in Applied Probability, Vol. 21, pp. 181-206, 1989.
P. Heidelberger, Xi-Ren Cao, M. Zazanis, and R. Suri, "Convergence Properties of Infinitesimal Perturbation Analysis Estimates", Management Science, Vol. 34, No. 11, pp. 1281-1302, 1988.
Xi-Ren Cao, "On a Sample Performance Function of Jackson Queueing Networks", Operations Research, Vol. 36, No. 1, pp. 128-136, 1988.
Xi-Ren Cao, "Realization Probability in Closed Jackson Queueing Networks and Its Application", Advances in Applied Probability, Vol. 19, pp. 708-738, 1987.
Xi-Ren Cao and Yves Dallery, "An Operational Approach to Perturbation Analysis of Closed Queueing Networks", Mathematics and Computers in Simulation, Vol. 28, pp. 433-451, 1986.
Y. C. Ho and Xi-Ren Cao, "Performance Sensitivity to Routing Changes in Queueing Networks and Flexible Manufacturing Systems Using Perturbation Analysis", IEEE Journal of Robotics and Automation, Vol. RA-1, No. 4, pp. 165-172, December, 1985.
Xi-Ren Cao, "The Dependence of Sojourn Times on Service Times in Tandem Queues", Journal of Applied Probability, Vol. 21, pp. 661-667, 1984.

Back to list

5. Game Theory & Application

Xi-Ren Cao, Hongxia Shen, Rodolfo Milito, and Patrica Wirth, "Internet Pricing With a Game Theoretical Approach: Concepts and Examples", IEEE/ACM Transactions on Networking, Vol. 10, pp. 208-216, 2002.
Xi-Ren Cao, "Performance Functions and Bargaining Solutions", The best student paper in 1982 student paper competition, Proceedings of the 21st IEEE Conference on Decision and Control, pp. 164-171, Orlando, Florida, Dec. 1982.

Back to list

6. Surveys and Tutorials

Y. C. Ho and Xi-Ren Cao, "Sample Path Analysis of Discrete Event Systems", The Encyclopedia of Life Support Systems (EOLSS), to appear.
Xi-Ren Cao, "From Perturbation Analysis to Markov Decision Processes and Reinforcement Learning ", Discrete Event Dynamic Systems: Theory and Applications, Vol. 13, pp. 9-39, 2003.
Xi-Ren Cao, "A Sensitivity View of Markov Decision Processes and Reinforcement Learning", 2002.
Xi-Ren Cao, "Performance Potential-Based Optimization and Markov Decision Processes", Stochastic Models and Optimization, D. D. Yao, H. Zhang and X. Y. Zhou (Eds.), Springer, New York, 2002.
R. Boel, Xi-Ren Cao, G. Cohen, A. Giua, W. M. Wonham, J. H. Van Schuppen, "Unity in Diversity, Diversity in Unity: Retrospective and Prospective Views on Control of Discrete Event Systems", Discrete Event Dynamic Systems: Theory and Applications, Vol. 12, pp. 253-264, 2002.
Xi-Ren Cao, "Discrete Event Dynamic Systems (DEDS), Wiley Encyclopedia of Electrical and Electronics Engineering, Vol. 5, pp. 602-612, 1999.
Xi-Ren Cao, "Perturbation Analysis of Discrete Event Systems: Concepts, Algorithms, and Applications, (Invited Review) European Journal of Operational Research, Vol. 91, pp. 1-13, 1996.
Xi-Ren Cao, "Infinitesimal Perturbation Analysis of Generalized Semi-Markov Processes: A Tutorial, (invited) Discrete Event Systems, G. Cohen and J. -P. Quadrat (Eds.), pp. 401-408, Springer-Verlag, 1994.
Xi-Ren Cao and Y. C. Ho, "Models of Discrete Event Dynamic Systems", Invited paper for the IEEE Control Systems Magazine, Vol. 10, No. 6, pp. 69-76, 1990.

Back to list

7. Others

Han Fu Chen and Xi-Ren Cao, "Pole Assignment for Stochastic Systems With Unknown Coefficients", Science in China (Series E), Vol. 43, No. 3, pp. 313-323, 2000.

Han-Fu Chen and Xi-Ren Cao, "Controllability is Not Necessary for Adaptive Pole Placement Control", IEEE Transactions on Automatic Control, Vol. 42, pp. 1222-1229, 1997.

Xi-Ren Cao, "The Predictability of Discrete Event Systems", IEEE Transactions on Automatic Control, Vol. 34, pp. 1168-1171, 1989.
Xi-Ren Cao, "The Explicit Solution of the Unnormalized Conditional Probability Equation of a One-dimensional Linear System", Systems and Control Letters, Vol. 3, pp. 13-22, 1983.

Back to list

8. Conference

Xi-Ren Cao and Xianping Guo, "Partially Observable Markov Decision Processes With Reward Information", Proceeding of 43rd IEEE Conference on Decision and Control, Atlantis, Paradise Island, Bahamas, December 14-17, 2004.
Brahim Bensaou, Shixin Zhuang and Xi-Ren Cao, "Statistical Bounds on the Drop Probability of Assured Forwarding Services in DiffServ Interior Nodes under the Processor Sharing Scheduling Discipline", Proceedings of the 23rd IEEE International Performance Computing and Communications Conference, 2004.
Xi-Ren Cao, "A system Theoretic Perspective of Learning and Optimization", Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, Hawaii USA, December 2003.
Xi-Ren Cao, "Constructing Performance Sensitivities of Markov Systems with Potentials as Building Blocks", Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, Hawaii USA, December 2003.
Xi-Ren Cao and Hai-Tao Fang, "Gradient-Based Policy Iteration: An example", Proceedings of the 41st IEEE Conference on Decision and Control Las Vegas, Nevada USA, December 2002.
Ming He and Xi-Ren Cao, "Adaptive Error Control for Mobile Networks: On-line Optimization Based on a Single Sample Path", Proceedings of the 40th IEEE Conference on Decision and Control Orlando, Florida USA, December 2001.
Xi-Ren Cao and Hong-Xia Shen, "Internet Pricing: Comparison and Examples", Proceedings of the 39th IEEE Conference on Decision and Control Sydney, Australia, December 2000.
Xi-Ren Cao, "An Introduction to Ensemble-Average Importance Sampling of Markov Chains", Proceedings of the 30th IEEE Conference on Decision and Control Brighton, England, December 1991.

Publications List in Different Areas