HOME            PUBLICATIONS            CV            PERSONAL            CLASSES

 


Selected Publications and Preprints

 [Full list of publications]

 

 

Preprints

  • A.M. Devraj, I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity in a weighted Sobolev space." Submitted. [pdf]
  • M. Madiman and I. Kontoyiannis. "Entropy bounds on abelian groups and the Ruzsa divergence." To appear, IEEE Trans. Information Theory. [pdf]

 

Published or in press, 2016-present

  • I. Kontoyiannis and S.P. Meyn. "Approximating a diffusion by a finite-state hidden Markov model." Stochastic Processes and their Applications, 127, no. 8, pp. 2482-2507, August 2017. [pdf]
  • D. Cheliotis, I. Kontoyiannis, M. Loulakis and S. Toumpis. "Exact speed and transmission cost in a simple one-dimensional wireless delay-tolerant network." IEEE International Symposium on Information Theory, Aachen, Germany, June 2017. [pdf]
  • I. Kontoyiannis and S.P. Meyn. "On the f-norm ergodicity of Markov processes in continuous time." Electronic Comm. in Probab., 21, paper 77, pp. 1-10, November 2016. [pdf] [journal]
  • I. Kontoyiannis and M. Skoularidou. "Estimating the directed information and testing for causality."  IEEE Trans. Information Theory, 62, no. 11, pp. 6053-6067, November 2016. [pdf]


  • 2009-2015

  • Book: (in Greek) I. Kontoyiannis and S. Toumpis. "Elements of Probability: With Applications in Statistics and Computer Science."  Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation in Greek: Γ. Κοντογιάννης και Σ. Τουμπής. "Στοιχεία πιθανοτήτων: Με εφαρμογές στη στατιστική και την πληροφορική". Σύνδεσμος Ελληνικών Ακαδημαϊκών Βιβλιοθηκών, Αθήνα, 2015.] ISBN: 978-960-603-182-3 [Official Page] [Latest Version] [Searchable pdf without hyperlinks]
  • I. Kontoyiannis and M. Madiman. "Sumset and inverse sumset inequalities for differential entropy and mutual information." IEEE Trans. Information Theory, 60, no. 8, pp. 4503-4514, August 2014. [ps] [pdf]
  • I. Kontoyiannis and S. Verd˙. "Optimal lossless data compression: Non-asymptotics and asymptotics." IEEE Trans. Information Theory, 60, no. 2, pp. 777-795, February 2014. [pdf]
  • Y. Altuğ, I. Kontoyiannis and A.B. Wagner. "Lossless compression with moderate error probability." 2013 IEEE International Symposium on Information Theory, Istanbul, Turkey, July 2013. [pdf]
  • O. Johnson, I. Kontoyiannis and M. Madiman. "Log-concavity, ultra-log-concavity and a maximum entropy property of discrete compound Poisson measures." Discrete Applied Mathematics (Special issue, Proceedings of the Jubilee Conference on Discrete Mathematics JCDM 2009, D. J. Kleitman, A. Shastri, V. T. So's, eds.) 161, no. 9, pp. 1232-1250, June 2013. [ps] [pdf]. See also earlier version on the [arXiv] 
  • C. Gioran and I. Kontoyiannis. "Complexity-compression tradeoffs in lossy compression via efficient random codebooks and databases." Problems of Information Transmission, 48, Issue 4, pp. 376-394, October, 2012. [ps] [pdf]
  • I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity and the spectral gap of non-reversible Markov chains." Probability Theory and Related Fields, 154, Issue 1-2, pp. 327-339, October 2012. [ps] [pdf]
  • V. Anantharam, G. Caire, M. Costa, I. Kontoyiannis, G. Kramer, R. Yeung, and S. Verd˙. "Panel on New Perspectives on Information Theory." (Invited discussion.) IEEE Information Theory Society Newsletter, pp. 21-27, March 2012. [pdf] 
  • P. Dellaportas and I. Kontoyiannis. "Control variates for estimation based on reversible Markov chain Monte Carlo samplers." Journal of the Royal Statistical Society: Series B, 74, Part 1, pp. 133-161, 2012. [ps] [pdf]
  • P. HarremoŰs, O. Johnson and I. Kontoyiannis. "Thinning, entropy and the law of thin numbers." IEEE Trans. Inform. Theory, 56, no. 9, pp. 4228-4244, September 2010. [ps] [pdf]
  • A.D. Barbour, O. Johnson, I. Kontoyiannis and M. Madiman. "Compound Poisson approximation via information functionals." Electronic J. of Probab., 15, paper 42, pp. 1344-1368, August 2010. [ps] [pdf]
  • A. Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I. Kontoyiannis and E. Upfal. "Probabilistic analysis of the k-server problem on the circle." Unpublished manuscirpt, May 2010. [ps] [pdf]
  • P. Dellaportas and I. Kontoyiannis. "Notes on using control variates for estimation with reversible MCMC samplers." Notes, July 2009 [arXiv]

 

2006-2008

  • M. Harrison and I. Kontoyiannis "Estimation of the rate-distortion function." IEEE Trans. Inform. Theory, 54, pp. 3757-3763, August 2008. [ps] [pdf] See also the longer version with additional results, details and proofs on the [arXiv]
  • I. Kontoyiannis. "Book review: "Information and complexity in statistical modeling," by J. Rissanen, Springer, NY, 2007." Amer. Math. Monthly, 115, no. 10, pp. 956-960, December 2008. [ps] [pdf] [pdf]
  • I. Kontoyiannis and S.P. Meyn. "Computable exponential bounds for screened estimation and simulation." Ann. Appl. Probab., 18, pp. 1491-1518, August 2008. [ps] [pdf]
  • Y. Gao, I. Kontoyiannis and E. Bienenstock. "Estimating the entropy of binary time series: Methodology, some theory and a simulation study." Entropy, 10, issue 2, pp. 71-99, June 2008. [ps] [pdf] [pdf]
  • I. Kontoyiannis. "Counting the primes using entropy." IEEE Information Theory Society Newsletter, 58, no. 2, pp. 6-9, June 2008. [ps] [pdf] [pdf] Slides from a talk on this work at ITW 2008 in Porto, May 2008 [ps] [pdf]
  • I. Kontoyiannis. "Some information-theoretic computations related to the distribution of prime numbers." In Festschrift in Honor of Jorma Rissanen, (P. Grunwald, P. Myllymaki, I. Tabus, M. Weinberger, B. Yu, eds.), pp. 135-143, Tampere University Press, May 2008. [ps] [pdf] Slides from a talk on this work at ITW 2008 in Porto, May 2008 [ps] [pdf]
  • H.M. Aktulga, I. Kontoyiannis, L.A. Lyznik, L. Szpankowski, A.Y. Grama and W. Szpankowski. "Identifying statistical dependence in genomic sequences via mutual information estimates." EURASIP J. Bioinform. Syst. Biol., vol. 2007, article ID 14741, 2007. [ps] [pdf] [journal]
  • P. HarremoŰs, O. Johnson and I. Kontoyiannis. "Thinning and the law of small numbers." 2007 IEEE International Symposium on Information Theory, Nice, France, June 2007. [ps] [pdf]
  • M. Madiman, O. Johnson and I. Kontoyiannis. "Fisher information, compound Poisson approximation, and the Poisson channel." 2007 IEEE International Symposium on Information Theory, Nice, France, June 2007. [ps] [pdf]
  • I. Kontoyiannis, L.A. Lastras-Monta˝o and S.P. Meyn. "Exponential bounds and stopping rules for MCMC and general Markov chains." First International Conference on Performance Evaluation Methodologies and Tools, Pisa, Italy, October 2006. [ps] [pdf]
  • Y. Gao, I. Kontoyiannis and E. Bienenstock. "From the entropy to the statistical structure of spike trains." 2006 IEEE International Symposium on Information Theory, Seattle, WA, July 2006. [ps] [pdf]
  • I. Kontoyiannis and M. Madiman. "Measure concentration for compound Poisson distributions." Electronic Comm. in Probab., 11, paper 5, pp. 45-57, May 2006. [ps] [pdf] [journal]
  • I. Kontoyiannis and R. Zamir. "Mismatched codebooks and the role of entropy-coding in lossy data compression." IEEE Trans. Inform. Theory, 52, pp. 1922-1938, May 2006. [ps] [pdf] [pdf]

 

2003-2005

  • I. Kontoyiannis, L.A. Lastras-Monta˝o and S.P. Meyn. "Relative entropy and exponential deviation bounds for general Markov chains." 2005 IEEE International Symposium on Information Theory, Adelaide, Australia, September 2005. [ps] [pdf]
  • I. Kontoyiannis and B. Lucena. "Mutual information, synergy, and some curious phenomena for simple channels." 2005 IEEE International Symposium on Information Theory, Adelaide, Australia, September 2005. [ps] [pdf]
  • B. Lucena and I. Kontoyiannis. "Filtering: The case for "noisier" data." 2005 IEEE Information Theory Workshop, Rotorua, New Zealand, September 2005. [ps] [pdf]
  • A. Anagnostopoulos, I. Kontoyiannis and E. Upfal. "Steady state analysis of balanced allocation routing." Random Structures & Algorithms, 26, pp. 446-467, July 2005. [ps] [ps.gz] [pdf] [journal]
  • I. Kontoyiannis and S.P. Meyn. "Large deviations asymptotics and the spectral theory of multiplicatively regular Markov processes." Electronic J. of Probab., 10, paper 3, pp. 61-123, February 2005. [ps] [pdf] [journal] See also the slides from a presentation on this work: [ps] [pdf]
  • I. Kontoyiannis, P. HarremoŰs and O. Johnson. "Entropy and the law of small numbers." IEEE Trans. Inform. Theory, 51, pp. 466-472, February 2005. [ps] [pdf] [pdf]
  • I. Kontoyiannis and M. Madiman. "Entropy, compound Poisson approximation, log-Sobolev inequalities and measure concentration." 2004 IEEE Information Theory Workshop, San Antonio, TX, October 2004. [ps] [ps.gz] [pdf]
  • M. Madiman, M. Harrison and I. Kontoyiannis. "Minimum Description Length vs. Maximum Likelihood in lossy data compression." 2004 IEEE International Symposium on Information Theory, Chicago, IL, July 2004. [ps] [pdf] See also the slides from a presentation on this work at an MSRI Workshop in February, 2002. [ps] [pdf]
  • Y. Gao, I. Kontoyiannis and E. Bienenstock. "Estimating the entropy rate of spike trains." 38th Annual Conference on Information Sciences and Systems, Princeton, NJ, March 2004. [ps] [pdf]
  • I. Kontoyiannis. "Pattern matching and lossy data compression on random fields." IEEE Trans. Inform. Theory, 49, pp. 1047-1051, April 2003. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis and A.D. Sezer. "A remark on unified error exponents: Hypothesis testing, data compression and measure concentration." Barcelona Conference on Stochastic Inequlities and Their Applications, Spain, 2002; published in Progress in Probability, vol 56, pp. 23-32, Birkhauser, Basel/Switzerland, 2003. [ps] [ps.gz] [pdf]
  • N. Merhav and I. Kontoyiannis. "Source coding exponents for zero-delay coding with finite memory." IEEE Trans. Inform. Theory, 49, pp. 609-625, March 2003. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis and S.P. Meyn. "Spectral theory and limit theorems for geometrically ergodic Markov processes." Ann. Appl. Probab., 13, pp. 304-362, February 2003. [ps] [ps.gz] [pdf]

 

2000-2002

  • M. Harrison and I. Kontoyiannis. "Maximum likelihood estimation for lossy data compression" (invited paper). 40th Allerton Conference on Communication, Control and Computing, Allerton, IL, October 2002. [ps] [ps.gz] [pdf]
  • V. Castelli and I. Kontoyiannis. "An efficient recursive partitioning algorithm for classification, using wavelets." APPTS Report #02-7, Division of Applied Math, Brown University, September 2002. [ps] [ps.gz] [pdf]
  • J. Huang, I. Kontoyiannis and S.P. Meyn. "The ODE method and spectral theory of Markov operators." In Proceedings of Stochastic Theory and Control Workshop, Springer, New York, pp. 205-221, B. Pasik-Duncan (Editor), 2002. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis and J. Zhang. "Arbitrary source models and Bayesian codebooks in rate-distortion theory." IEEE Trans. Inform. Theory, 48, pp. 2276-2290, August 2002. [ps] [ps.gz] [pdf]
  • A. Dembo and I. Kontoyiannis. "Source coding, large deviations, and approximate pattern matching." Invited paper in IEEE Trans. Inform. Theory special issue on Shannon theory, dedicated to Aaron D. Wyner, 48, pp. 1590-1615, June 2002. [ps] [ps.gz] [pdf]
  • A. Antos and I. Kontoyiannis. "Convergence properties of functional estimates for discrete distributions." Random Structures & Algorithms, 19, pp. 163-193. October 2001. [ps] [ps.gz] [pdf]
  • J. Zhang, E.K.P. Chong and I. Kontoyiannis. "Unified spatial diversity combining and power allocation schemes for CDMA systems." IEEE J. on Selected Areas in Comm., 19, pp. 1276-1288, July 2001. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis. "Sphere-covering, measure concentration, and source coding." IEEE Trans. Inform. Theory, 47, pp. 1544-1552, May 2001. [ps] [ps.gz] [pdf (without figures)] [pdf (with figures)]
  • A. Dembo and I. Kontoyiannis. "Critical behavior in lossy source coding." IEEE Trans. Inform. Theory, 47, pp. 1230-1236, March 2001. [ps] [ps.gz] [pdf (without figures)] [pdf (with figures)]
  • Patent: "Multiresolution lossless/lossy compression and storage of data for efficient processing thereof." With V. Castelli, J. Robinson and J.J. Turek. U.S. Patent No. 6,141,445. October 2000. [HTML]
  • I. Kontoyiannis. "Model selection via rate-distortion theory" (invited paper). 34th Annual Conference on Information Sciences and Systems, March 2000. [ps] [ps.gz] [pdf]
  • Patent: "Multiresolution lossless/lossy compression and storage of data for efficient processing thereof." With V. Castelli, J. Robinson and J.J. Turek. U.S. Patent No. 6,021,224. February 2000. [HTML]
  • I. Kontoyiannis. "Pointwise redundancy in lossy data compression and universal lossy data compression." IEEE Trans. Inform. Theory, 46, pp. 136-152, January 2000. [ps] [ps.gz] [pdf]

 

1999 and earlier

  • I. Kontoyiannis. "An implementable lossy version of the Lempel-Ziv algorithm -- Part I: Optimality for memoryless sources." IEEE Trans. Inform. Theory, 45, pp. 2293-2305, November 1999. [ps] [ps.gz] [pdf]
  • A. Dembo and I. Kontoyiannis. "Critical behavior in data compression." Technical Report no. TR-99-26, Department of Statistics, Purdue University, November 1999. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis. "Efficient sphere-covering and converse measure concentration via generalized coding theorems." Technical Report no. TR-99-26, Department of Statistics, Purdue University, October 1999. [ps] [ps.gz] [pdf (without figures)] [pdf (with figures)]
  • A. Dembo and I. Kontoyiannis. "The asymptotics of waiting times between stationary processes, allowing distortion." Ann. Appl. Probab., 9, pp. 413-429, May 1999. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis. "Asymptotic recurrence and waiting times for stationary processes." J. Theoret. Probab., 11, pp. 795-811, July 1998. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis, P.H. Algoet, Yu.M. Suhov and A.J. Wyner. "Nonparametric entropy estimation for stationary processes and random fields, with applications to English text." IEEE Trans. Inform. Theory, 44, pp. 1319-1327, May 1998. [ps] [ps.gz] [pdf]
  • Ph.D. Thesis: "Recurrence and Waiting Times in Stationary Processes, and their Applications in Data Compression." Department of Electrical Engineering, Stanford University, May 1998. [HTML]
  • V. Castelli, L. Bergman, I. Kontoyiannis, C.-S. Li, J. Robinson and J. Turek. "Progressive search and retrieval in large image archives." IBM J. Res. Develop., 42, pp. 253-268, March 1998. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis. "Second-order noiseless source coding theorems." IEEE Trans. Inform. Theory, 43, pp. 1339-1341, July 1997. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis. "The complexity and entropy of literary styles." NSF Technical Report no. 97, Department of Statistics, Stanford University, June 1996. [ps] [ps.gz] [pdf]
  • V. Castelli, I. Kontoyiannis, C.S. Li, and J.J. Turek. "Progressive classification in the compressed domain for large EOS satellite databases." 1996 IEEE International Conference on Acoustics, Speech and Signal Processing. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis, J. Turek, V. Castelli and J. Robinson. "Multiresolution lossless image compression." Unpublished manuscript, December 1995. [ps] [ps.gz] [pdf]
  • I. Kontoyiannis and Yu.M. Suhov. "Prefixes and the entropy rate for long-range sources." In Probability Statistics and Optimization: A tribute to Peter Whittle (F.P. Kelly ed.), pp. 89-98, Wiley, 1994. [ps] [ps.gz] [pdf]