Official PYQ · 2023Set 1 · Q55Information TheoryNAT2 marks

GATE EC 2023 Set 1 Q55 — Information Theory

The frequency of occurrence of $8$ symbols $(a-h)$ is shown in the table below. A symbol is chosen and it is determined by asking a series of $\text{"yes/no"}$ questions which are assumed to be truthfully answered. The average number of questions when asked in the most efficient sequence, to determine the chosen symbol, is _______________ (rounded off to two decimal places).

Symbols	a	b	c	d	e	f	g	h
Frequency of occurence	$\frac{1}{2}$	$\frac{1}{4}$	$\frac{1}{8}$	$\frac{1}{16}$	$\frac{1}{32}$	$\frac{1}{64}$	$\frac{1}{128}$	$\frac{1}{128}$

View answer

Answer: 1.97:1.99

Worked explanation not available yet.

Free practice · Your answers on this page are not saved.

Published 10 Oct 2026

Report a correction

GATE EC · 2026Information Theory
Let the relevant bandwidth $(B)$ of a digital communication system be $1 ~\text{MHz}$ and $k T=-174 \mathrm{~dBm} / \mathrm{Hz}$ , where $k$ is Boltzmann's constant and ' $T$ ' is equivalent noise temperature of the receiver. The power $(S)$ of signal received through an additive Gaussian channel is $-80 ~\text{dBm}.$ Which of the following …
MSQ · 2 marks
GATE EC · 2025Information Theory
Consider an additive white Gaussian noise (AWGN) channel with bandwidth $W$ and noise power spectral density $\frac{N_{0}}{2}$ . Let $P_{a v}$ denote the average transmit power constraint. Which one of the following plots illustrates the dependence of the channel capacity $C$ on the bandwidth $W$ (keeping $P_{a v}$ and $N_{0}$ fixed)?
MCQ · 1 mark
GATE EC · 2025Information Theory
$X$ and $Y$ are Bernoulli random variables taking values in $\{0,1\}$ . The joint probability mass function of the random variables is given by: $\begin{array}{l} P(X=0, Y=0)=0.06 \\ P(X=0, Y=1)=0.14 \\ P(X=1, Y=0)=0.24 \\ P(X=1, Y=1)=0.56 \end{array}$ The mutual information $I(X ; Y)$ is $\_\_\_\_\_\_\_\_$ (rounded off to two decimal places).
NAT · 2 marks
GATE EC · 2024Information Theory
A source transmits symbols from an alphabet of size $16$ . The value of maximum achievable entropy (in bits) is $\_\_\_\_\_\_$ .
NAT · 1 mark
GATE EC · 2022Information Theory
The transition diagram of a discrete memoryless channel with three input symbols and three output symbols is shown in the figure. The transition probabilities are as marked. The parameter $\alpha$ lies in the interval $[0.25, 1].$ The value of $\alpha$ for which the capacity of this channel is maximized, is ___________ (rounded off to two decimal …
NAT · 2 marks
GATE EC · 2021Information Theory
A speech signal, band limited to $4\:\text{kHz}$ , is sampled at $1.25$ times the Nyquist rate. The speech samples, assumed to be statistically independent and uniformly distributed in the range $-5\:V$ to $+5\:V$ , are subsequently quantized in an $8$ -bit uniform quantizer and then transmitted over a voice-grade $\text{AWGN}$ telephone channel. If …
NAT · 1 mark

Browse this topic

More Information Theory questions

GATE EC 2023 Set 1 Q55 — Information Theory

Related questions