Electronics and Communication Engineering (ECE) Exam  >  Electronics and Communication Engineering (ECE) Questions  >  Read the following expression regarding mutua... Start Learning for Free
Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correct
  • a)
    I(X;Y) = H(X) – H(Y/X)
  • b)
    I(X;Y) = H(X) – H(X/Y)
  • c)
    I(X;Y) = H(X) + H(Y) – H(X,Y)
  • d)
    I(X;Y) = H(X) + H(Y) + H(X,Y)
Correct answer is option 'B,C'. Can you explain this answer?
Verified Answer
Read the following expression regarding mutual information I(X;Y). Whi...
Mutual Information measures the amount of information that one Random variable contains about another Random variable.
The mutual information between two jointly distributed discrete Random variables X and Y is given by:

In terms of Entropy, this is written as:
I(X ; Y) = H(X) – H(X/Y)        ---(1)
(Option (b) is correct)
Also, the conditional entropy states that:
H(X, Y) = H(Y/X) + H(X)
H(X, Y) = H(X/Y) + H(Y)
From above equations we can write:
H(X/Y) = H(X, Y) – H(Y)        ---(2)
Using Equations (1) and (2), we can write:
I(X ; Y) = H(X) – [H(X, Y) – H(Y)]
I(X ; Y) = H(X) + H(Y) – H(X, Y)        ---(3)
(Option (c) is correct)
View all questions of this test
Explore Courses for Electronics and Communication Engineering (ECE) exam
Question Description
Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? for Electronics and Communication Engineering (ECE) 2025 is part of Electronics and Communication Engineering (ECE) preparation. The Question and answers have been prepared according to the Electronics and Communication Engineering (ECE) exam syllabus. Information about Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? covers all topics & solutions for Electronics and Communication Engineering (ECE) 2025 Exam. Find important definitions, questions, meanings, examples, exercises and tests below for Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer?.
Solutions for Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? in English & in Hindi are available as part of our courses for Electronics and Communication Engineering (ECE). Download more important topics, notes, lectures and mock test series for Electronics and Communication Engineering (ECE) Exam by signing up for free.
Here you can find the meaning of Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? defined & explained in the simplest way possible. Besides giving the explanation of Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer?, a detailed solution for Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? has been provided alongside types of Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? theory, EduRev gives you an ample number of questions to practice Read the following expression regarding mutual information I(X;Y). Which of the following expressions is/are correcta)I(X;Y) = H(X) – H(Y/X)b)I(X;Y) = H(X) – H(X/Y)c)I(X;Y) = H(X) + H(Y) – H(X,Y)d)I(X;Y) = H(X) + H(Y) + H(X,Y)Correct answer is option 'B,C'. Can you explain this answer? tests, examples and also practice Electronics and Communication Engineering (ECE) tests.
Explore Courses for Electronics and Communication Engineering (ECE) exam
Signup to solve all Doubts
Signup to see your scores go up within 7 days! Learn & Practice with 1000+ FREE Notes, Videos & Tests.
10M+ students study on EduRev