Register

Adv. Query

Q&A (4754)

Reviews (198)

Open problems (41)
Meta (436)

Site Statistics

202 submissions , 160 unreviewed
4,973 questions , 2,138 unanswered
5,333 answers , 22,596 comments
1,470 users with positive rep
812 active unimported users
More ...

Where can I find a graphical representation or a detailed explanation illustrating the relationship between Shannon information entropy, probability and available information?

172 views

Where can I find a graphical representation or a detailed explanation illustrating the relationship between Shannon information entropy, probability and available information?

asked Oct 4, 2022 in Mathematics by rhkail [ no revision ]

This is often discussed in texts about the maximum entropy formalism of nonequilibrium statistical mechanics...

commented Oct 4, 2022 by Dilaton (6,240 points) [ no revision ]

Your comment on this question:

To answer, leave an answer instead. Comments are usually for non-answers.
To mask links under text, please type your text, highlight it, and click the "link" button. You can then enter your link URL.
To alert a user, please use the "@" command and remove spaces from the username, example, the user "John Doe" should be pinged as "@JohnDoe", while the user "Johndoe" should be pinged as "@Johndoe". The post author is always automatically pinged (unless you are the post author).
Please consult the FAQ for as to how to format your post.

Live preview (may slow down editor) Preview

Your name to display (optional):

Email me at this address if a comment is added after mine:

Privacy: Your email address will only be used for sending these notifications.

Anti-spam verification:

[captcha placeholder]

To avoid this verification in future, please log in or register.

Your answer

Please use answers only to (at least partly) answer questions. To comment, discuss, or ask for clarification, leave a comment instead.
To mask links under text, please type your text, highlight it, and click the "link" button. You can then enter your link URL.
Please consult the FAQ for as to how to format your post.
This is the answer box; if you want to write a comment instead, please use the 'add comment' button.

Live preview (may slow down editor) Preview

Your name to display (optional):

Email me at this address if my answer is selected or commented on:

Privacy: Your email address will only be used for sending these notifications.

Anti-spam verification:

If you are a human please identify the position of the character covered by the symbol $\varnothing$ in the following word:
$\varnothing\hbar$ysicsOverflow
Then drag the red bullet below over the corresponding character of our banner. When you drop it there, the bullet changes to green (on slow internet connections after a few seconds).

To avoid this verification in future, please log in or register.

user contributions licensed under cc by-sa 3.0 with attribution required

Your rights

...