FULL [LIST] OF PUBLICATIONS

PREPRINTS

●
A.M. Devraj, I. Kontoyiannis and S.P. Meyn. "Geometric
ergodicity in a weighted Sobolev space." Submitted. [pdf]

●
M. Madiman and I. Kontoyiannis. "Entropy bounds
on abelian groups and the Ruzsa divergence." To appear, *IEEE Trans.
Information Theory*. [pdf]

2016-PRESENT

●
M. Riabiz, T. Ardeshiri, I. Kontoyiannis and S
Godsill. "Simulated convergence rates with application to an intractable
alpha-stable inference problem." (invited paper) *IEEE International Workshop on Computational Advances
in Multi-Sensor Adaptive Processing*, Curaçao, Dutch Antilles, December 2017. [pdf]

●
I. Kontoyiannis and S.P. Meyn. "Approximating a
diffusion by a finite-state hidden Markov model." *Stochastic Processes and their Applications*, **127**, no. 8, pp. 2482-2507, August 2017. [pdf]

●
D. Cheliotis, I. Kontoyiannis, M. Loulakis and S.
Toumpis. "Exact speed and transmission cost in a simple one-dimensional
wireless delay-tolerant network." *IEEE International Symposium on
Information Theory*, Aachen, Germany, June 2017.
[pdf]

●
I. Kontoyiannis and S.P. Meyn. "On the *f*-norm
ergodicity of Markov processes in continuous time." *Electronic Comm. in Probab.*,** 21**, paper
77, pp. 1-10, November 2016. [pdf] [journal]

● I.
Kontoyiannis and M. Skoularidou. "Estimating the directed information and
testing for causality." *IEEE Trans. Information Theory*, **62**,
no. 11, pp. 6053-6067,
November 2016. [pdf]

2009-2015

●
**Book**: (in Greek)
I. Kontoyiannis and S. Toumpis. "*Elements
of Probability: With Applications in Statistics and Computer Science*."
Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation
in Greek:* *Γ.
Κοντογιάννης
και Σ. Τουμπής.
*"Στοιχεία
πιθανοτήτων:
Με εφαρμογές
στη στατιστική
και την
πληροφορική". *Σύνδεσμος
Ελληνικών
Ακαδημαϊκών
Βιβλιοθηκών,
Αθήνα, 2015.] ISBN: 978-960-603-182-3
[Official
Page] [Latest Version]
[Searchable pdf without
hyperlinks]

●
I. Kontoyiannis and M. Madiman. "Sumset and
inverse sumset inequalities for differential entropy and mutual
information." *IEEE Trans. Information Theory*, **60**, no. 8, pp.
4503-4514, August 2014. [pdf]

●
Kontoyiannis and S. Verdú. "Optimal
lossless data compression: Non-asymptotics and asymptotics." *IEEE
Trans. Information Theory*, **60**, no. 2, pp. 777-795, February 2014. [pdf]

●
Y. Altuğ, I. Kontoyiannis and A.B. Wagner.
"Lossless compression with moderate error probability." *2013 IEEE
International Symposium on Information Theory*, Istanbul, Turkey, July 2013.
[pdf]

●
O. Johnson, I. Kontoyiannis and M. Madiman.
"Log-concavity, ultra-log-concavity and a maximum entropy property of
discrete compound Poisson measures." *Discrete
Applied Mathematics* (Special issue, Proceedings of the Jubilee Conference
on Discrete Mathematics JCDM 2009, D. J. Kleitman, A. Shastri, V. T. So's,
eds.) **161**, no. 9, pp. 1232-1250, June 2013. [pdf] See also earlier version on the [arXiv]

●
C. Gioran and I. Kontoyiannis.
"Complexity-compression tradeoffs in lossy compression via efficient
random codebooks and databases." *Problems
of Information Transmission*, **48**, Issue 4, pp. 376-394, October 2012.
[pdf]

●
I. Kontoyiannis and S.P. Meyn. "Geometric
ergodicity and the spectral gap of non-reversible Markov chains." *Probability Theory and Related Fields*, **154**,
Issue 1-2, pp. 327-339, October 2012. [pdf]

●
V. Anantharam, G. Caire, M. Costa, I. Kontoyiannis, G.
Kramer, R. Yeung, and S. Verdú. "Panel on *New Perspectives on Information Theory*." (Invited discussion.)
*IEEE Information Theory Society
Newsletter*, pp. 21-27, March 2012. [pdf]

●
P. Dellaportas and I. Kontoyiannis. "Control
variates for estimation based on reversible Markov chain Monte Carlo
samplers." *Journal of the Royal
Statistical Society: Series B*, **74**,
Part 1, pp. 133-161, 2012. [pdf]

●
P. Harremoës, O. Johnson and I. Kontoyiannis.
"Thinning, entropy and the law of thin numbers." *IEEE Trans.
Inform. Theory*, **56**, no. 9, pp. 4228-4244, September 2010. [pdf]

●
A.D. Barbour, O. Johnson, I. Kontoyiannis and M.
Madiman. "Compound Poisson approximation via information
functionals." *Electronic J. of Probab.*, **15**, paper 42, pp. 1344-1368, August 2010.
[pdf]

●
A.
Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I. Kontoyiannis
and E. Upfal. "Probabilistic analysis of the *k*-server problem on the circle." Unpublished manuscript, May
2010. [pdf]

●
P. Dellaportas and I. Kontoyiannis. "Notes on
using control variates for estimation with reversible MCMC samplers." *Notes*, July 2009. [arXiv]

2006-2008

●
M. Harrison and I. Kontoyiannis "Estimation of
the rate-distortion function." *IEEE Trans. Inform. Theory*, **54**,
pp. 3757-3763, August 2008. [pdf] See also the
longer version with additional results, details and proofs on the [arXiv]

●
I. Kontoyiannis. "Book review: *"Information
and complexity in statistical modeling," by J. Rissanen, Springer, NY,
2007.*" *Amer. Math. Monthly*, **115**, no. 10, pp. 956-960,
December 2008. [pdf]
[pdf]

●
I. Kontoyiannis and S.P. Meyn. "Computable
exponential bounds for screened estimation and simulation." *Ann. Appl.
Probab.*, **18**, pp. 1491-1518, August 2008. [pdf]

●
Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy of binary time
series: Methodology, some theory and a simulation study." *Entropy,* **10**,
issue 2, pp. 71-99, June 2008. [pdf] [pdf]

●
I.
Kontoyiannis. "Counting the primes using entropy." *IEEE
Information Theory Society Newsletter*, **58**, no. 2, pp. 6-9, June
2008. [pdf] [pdf] Slides from a talk on this work at ITW 2008 in Porto,
May 2008 [pdf]

●
I. Kontoyiannis. "Some information-theoretic
computations related to the distribution of prime numbers." In *Festschrift
in Honor of Jorma Rissanen*, (P. Grunwald, P. Myllymaki, I. Tabus, M.
Weinberger, B. Yu, eds.), pp. 135-143,

●
H.M. Aktulga, I. Kontoyiannis, *EURASIP J. Bioinform.
Syst. Biol.*, vol. 2007, article ID 14741, 2007. [pdf] [journal]

●
P. Harremoës, O. Johnson and I. Kontoyiannis.
"Thinning and the law of small numbers." *2007 IEEE International
Symposium on Information Theory*, Nice, France, June 2007. [pdf]

●
M. Madiman, O. Johnson and I. Kontoyiannis.
"Fisher information, compound Poisson approximation, and the Poisson
channel." *2007 IEEE International Symposium on Information Theory*,
Nice, France, June 2007. [pdf]

●
I. Kontoyiannis, *First International
Conference on Performance Evaluation Methodologies and Tools*,

●
Y. Gao, I. Kontoyiannis and E. Bienenstock. "From
the entropy to the statistical structure of spike trains." *2006 IEEE
International Symposium on Information Theory*,

●
I. Kontoyiannis and M. Madiman. "Measure
concentration for compound Poisson distributions." *Electronic Comm. in Probab.*, **11**,
paper 5, pp. 45-57, May 2006. [pdf]
[journal]

●
I. Kontoyiannis and R. Zamir. "Mismatched codebooks and the role of
entropy-coding in lossy data compression." *IEEE Trans. Inform. Theory*,
**52**, pp. 1922-1938, May 2006. [pdf]
[pdf]

2003-2005

●
I. Kontoyiannis, *2005 IEEE International
Symposium on Information Theory*,

●
I. Kontoyiannis and B. Lucena. "Mutual
information, synergy, and some curious phenomena for simple channels." *2005
IEEE International Symposium on Information Theory*,

●
B. Lucena and I. Kontoyiannis. "Filtering: The
case for "noisier" data." *2005 IEEE Information Theory
Workshop*,

●
A. Anagnostopoulos, I. Kontoyiannis and E. Upfal.
"Steady state analysis of balanced allocation routing." *Random
Structures & Algorithms*, **26**, pp. 446-467, July 2005. [pdf] [journal]

●
I. Kontoyiannis and S.P. Meyn. "Large deviations
asymptotics and the spectral theory of multiplicatively regular Markov
processes." *Electronic
J. of Probab.*, **10**, paper 3, pp. 61-123, February 2005. [pdf] [journal] See also the slides from a presentation on this work:
[pdf]

●
I. Kontoyiannis, P. Harremoës and O. Johnson.
"Entropy and the law of small numbers." *IEEE Trans. Inform. Theory*,
**51**, pp. 466-472, February 2005. [pdf] [pdf]

●
I. Kontoyiannis and M. Madiman. "Entropy,
compound Poisson approximation, log-Sobolev inequalities and measure
concentration." *2004 IEEE Information Theory Workshop*,

●
M. Madiman, M. Harrison and I. Kontoyiannis.
"Minimum Description Length vs. Maximum Likelihood in lossy data
compression." *2004 IEEE International Symposium on Information Theory*,

●
Y. Gao, I. Kontoyiannis and E. Bienenstock.
"Estimating the entropy rate of spike trains." *38th Annual
Conference on Information Sciences and Systems*,

●
I. Kontoyiannis. "Pattern matching and lossy data
compression on random fields." *IEEE Trans. Inform. Theory*, **49**,
pp. 1047-1051, April 2003. [pdf]

●
I. Kontoyiannis and A.D. Sezer. "A remark on
unified error exponents: Hypothesis testing, data compression and measure
concentration." *Barcelona Conference on Stochastic Inequalities and
Their Applications,* Spain, 2002; published in *Progress in Probability,*
vol. 56, pp. 23-32, Birkhauser, Basel/Switzerland, 2003. [pdf]

●
N. Merhav and I. Kontoyiannis. "Source coding
exponents for zero-delay coding with finite memory." *IEEE Trans.
Inform. Theory*, **49**, pp. 609-625, March 2003.
[pdf]

●
I. Kontoyiannis and S.P. Meyn. "Spectral theory
and limit theorems for geometrically ergodic Markov processes." *Ann.
Appl. Probab.*, **13**, pp. 304-362, February 2003. [pdf]

2000-2002

●
M. Harrison and I. Kontoyiannis. "Maximum
likelihood estimation for lossy data compression" (invited paper). *40th
Allerton Conference on Communication, Control and Computing*,

●
V. Castelli and I. Kontoyiannis. "An efficient
recursive partitioning algorithm for classification, using wavelets." APPTS
Report
#02-7, Division of Applied Math,

●
J. Huang, I. Kontoyiannis and S.P. Meyn. "The ODE
method and spectral theory of Markov operators." In *Proceedings of
Stochastic Theory and Control Workshop*, Springer,

●
I. Kontoyiannis and J. Zhang. "Arbitrary source models and Bayesian codebooks
in rate-distortion theory." *IEEE Trans. Inform. Theory*, **48**,
pp. 2276-2290, August 2002. [pdf]

●
A. Dembo and I. Kontoyiannis. "Source coding,
large deviations, and approximate pattern matching." Invited paper in *IEEE
Trans. Inform. Theory* special issue on Shannon theory, dedicated to Aaron D.
Wyner, **48**, pp. 1590-1615, June 2002. [pdf]

●
A. Antos and I. Kontoyiannis. "Convergence
properties of functional estimates for discrete distributions." *Random
Structures & Algorithms*, **19**, pp. 163-193. October 2001. [pdf]

●
J. Zhang, E.K.P. Chong and I. Kontoyiannis.
"Unified spatial diversity combining and power allocation schemes for CDMA
systems." *IEEE J. on Selected Areas in Comm.*, **19**, pp.
1276-1288, July 2001. [pdf]

●
I. Kontoyiannis. "Sphere-covering, measure
concentration, and source coding." *IEEE Trans. Inform. Theory*, **47**,
pp. 1544-1552, May 2001. [pdf]
[pdf]

●
A. Dembo and I. Kontoyiannis. "Critical behavior
in lossy source coding." *IEEE Trans. Inform. Theory*, **47**, pp.
1230-1236, March 2001. [pdf]
[pdf]

●
**Patent**: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,141,445. October 2000. [HTML]

●
I. Kontoyiannis. "Model selection via
rate-distortion theory" (invited paper). *34th Annual Conference on
Information Sciences and Systems*, March 2000. [pdf]

●
**Patent**: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,021,224. February 2000. [HTML]

●
I. Kontoyiannis. "Pointwise redundancy in lossy
data compression and universal lossy data compression." *IEEE Trans.
Inform. Theory*, **46**, pp. 136-152, January 2000.
[pdf]

1999 & EARLIER

●
I. Kontoyiannis. "An implementable lossy version
of the Lempel-Ziv algorithm -- Part I: Optimality for memoryless sources."
*IEEE Trans. Inform. Theory*, **45**, pp. 2293-2305, November 1999. [pdf]

●
A. Dembo and I. Kontoyiannis. "Critical behavior
in data compression." Technical Report no. TR-99-26, Department of
Statistics,

●
I. Kontoyiannis. "Efficient sphere-covering and
converse measure concentration via generalized coding theorems." Technical
Report no. TR-99-26, Department of Statistics,

●
A. Dembo and I. Kontoyiannis. "The asymptotics of
waiting times between stationary processes, allowing distortion." *Ann.
Appl. Probab.,* **9**, pp. 413-429, May 1999. [pdf]

●
I. Kontoyiannis. "Asymptotic recurrence and
waiting times for stationary processes." *J. Theoret. Probab.,* **11**,
pp. 795-811, July 1998. [pdf]

●
I. Kontoyiannis, P.H. Algoet, Yu. M. Suhov and A.J.
Wyner. "Nonparametric entropy estimation for stationary processes and
random fields, with applications to English text." *IEEE Trans. Inform.
Theory*, **44**, pp. 1319-1327, May 1998. [pdf]

●
**Ph.D. Thesis**: "Recurrence and Waiting Times in Stationary
Processes, and their Applications in Data Compression." Department of
Electrical Engineering, Stanford University, May 1998. [HTML]

●
V. Castelli, L. Bergman, I. Kontoyiannis, C.-S. Li, J.
Robinson and J. Turek. "Progressive search and retrieval in large image
archives." *IBM J. Res. Develop.,* **42**, pp. 253-268, March
1998. [pdf]

●
I. Kontoyiannis. "Second-order noiseless source coding
theorems." *IEEE Trans. Inform. Theory*, **43**, pp. 1339-1341,
July 1997. [pdf]

●
I. Kontoyiannis. "The complexity and entropy of
literary styles." NSF Technical Report no. 97, Department of Statistics,

●
V. Castelli, I. Kontoyiannis, C.S. Li, and J.J. Turek.
"Progressive classification in the compressed domain for large EOS
satellite databases." *1996 IEEE International Conference on Acoustics,
Speech and Signal Processing*. [pdf]

●
I. Kontoyiannis, J. Turek, V. Castelli and J.
Robinson. "Multiresolution lossless image compression." Unpublished
manuscript, December 1995. [pdf]

●
I. Kontoyiannis and Yu. M. Suhov. "Prefixes and
the entropy rate for long-range sources." In *Probability Statistics and
Optimization: A tribute to Peter Whittle *(F.P. Kelly ed.), pp. 89-98,
Wiley, 1994. [pdf]