Information Theory
The field of Information
Theory was born out of Claude Shannon’s [see here or here]
landmark 1948 paper, A Mathematical
Theory of Communication. Current activity in the field can be found at
the IEEE Information Theory Society home
page.
o
The IEEE Transactions on Information
Theory is the main (western) journal devoted to
information theory
o
Problems of Information Transmission
is a translation of the Russian "Problemy Peredachi Informatsii"
o
A lot of information theory
preprints are posted on the cs.IT section
of the arXiv
o
Communications in Information and Systems
publishes papers in information theory
o
A more recent journal (started in
March 2003) is the International Journal of Quantum Information
o
Another journal started in 2003 is
the Foundations and Trends in
Communications and Information Theory
o
There is also an electronic
journal devoted to Entropy and its
relationship with various fields
o
And there's Information and Control
and its continuation Information and Computation
o
A web site
dedicated to current research activity on and around Rissanen's
Minimum Description Length Principle (MDL); many
interesting links
o
This blog
has posts on ideas related to information theory, computer vision and pattern
recognition
o
An article on the fascinating
connections between information
theory and fundamental physics
o
What some people think about the second law of thermodynamics
Originally motivated by
important problems in communications engineering, as a modern scientific field
information theory has fundamental connections with various other fields.