Does Maximizing Likelihood Over Truncated Support Increase Probability?

  • A
  • Thread starter kullbach_liebler
  • Start date
In summary, the paper investigates the effects of maximizing likelihood estimates over truncated support in statistical models. It examines whether this approach increases the probability of accurately estimating parameters compared to methods that do not account for truncation. The findings suggest that while maximizing likelihood over truncated support can enhance performance in certain contexts, it may not universally increase probability and can lead to biases if truncation mechanisms are not properly understood. The authors emphasize the importance of considering the implications of truncation in modeling to improve inference accuracy.
  • #1
kullbach_liebler
1
0
Suppose ##\mathbf{X}## is a random variable with a finite support ##\Omega## and with some pdf ##f(\cdot; \mathbf{v}_0)## where ##\mathbf{v}_0## is the parameter vector. Define, ##\mathcal{A}:= \{\mathbf{x}:S(\mathbf{x}) \geq \gamma\} \subset \Omega## and ##\tilde{\mathbf{x}}:=S(\tilde{\mathbf{x}}) = \gamma##, ##\mathcal{B}:=\{\mathbf{x} \geq \tilde{\mathbf{x}}\}## where ##S:\mathbf{x} \mapsto \mathbb{R}^n##. Moreover, suppose that,

$$\#(\mathcal{B} \cap \mathcal{A}) > \#(\neg \mathcal{B} \cap \mathcal{A})$$
and
$$!\exists \mathbf{x}^*>\tilde{\mathbf{x}}:=\arg \max_{\mathbf{x}}S(\mathbf{x}).$$

Then, it implies that,

\begin{align}
\max_{\mathbf{v}}\sum_{\mathbf{x} :S(\mathbf{x}) \geq \gamma} f(\mathbf{x};\mathbf{v}) > \sum_{\mathbf{x} :S(\mathbf{x}) \geq \gamma} f(\mathbf{x};\mathbf{v}_0)
\end{align}

My questions:

1) Is the statement true?;
2) How could I improve the presentation of this proposition?;
3) What are the mildest possible conditions under which (1) will hold?
 
Last edited:
Physics news on Phys.org
  • #2
kullbach_liebler said:
2) How could I improve the presentation of this proposition?;
I don't know what a statistical journal would want, but for the purpose of getting an answer on an internet forum, you could give a more verbal statement of the proposition before presenting it using only notation.

\begin{align}
\max_{\mathbf{v}}\sum_{\mathbf{x} :S(\mathbf{x}) \geq \gamma} f(\mathbf{x};\mathbf{v}) > \sum_{\mathbf{x} :S(\mathbf{x}) \geq \gamma} f(\mathbf{x};\mathbf{v}_0)
\end{align}

This appears to say the maximum value of a function ( which is a summation rather than an integration) when taken over a set is greater than the value of that function evaluated at the particular element ##v_o## in that set. Is that the general idea?
 
  • #3
kullbach_liebler said:
1) Is the statement true?
Let ## \mathbf{v_max} ## be a value of ## \mathbf{v} ## which maximizes the sum. What happens when ## \mathbf{v_0} = \mathbf{v_max} ##?
 

FAQ: Does Maximizing Likelihood Over Truncated Support Increase Probability?

What does "maximizing likelihood over truncated support" mean?

Maximizing likelihood over truncated support refers to the process of optimizing a likelihood function where the domain (support) of the variable is restricted or truncated. This is often done in cases where the data or the variable of interest is only observed within certain bounds, and the likelihood function is adjusted accordingly to reflect this truncated support.

How does truncation affect the likelihood function?

Truncation modifies the likelihood function by limiting the range of values that the variable can take. This changes the normalization constant of the probability distribution, as the total probability mass must now be redistributed over the truncated range. As a result, the likelihood function is adjusted to account for the fact that observations outside the truncated range are impossible or not considered.

Does maximizing the likelihood over truncated support lead to a higher probability for observed data?

Maximizing the likelihood over truncated support does not necessarily lead to a higher probability for the observed data in an absolute sense. Instead, it leads to the best possible fit given the constraints of the truncated range. The likelihood is maximized within the feasible region, which means the model parameters are adjusted to best explain the observed data within the truncated support.

How is the process of maximum likelihood estimation (MLE) affected by truncation?

In the presence of truncation, the MLE process must account for the restricted support by modifying the likelihood function accordingly. This often involves integrating the probability density function over the truncated range and adjusting the normalization constant. The resulting MLE estimates are those that maximize the truncated likelihood function, which may differ from the estimates obtained without truncation.

Are there any practical applications where maximizing likelihood over truncated support is particularly useful?

Yes, maximizing likelihood over truncated support is particularly useful in fields such as survival analysis, econometrics, and reliability engineering, where data may be censored or truncated. For example, in survival analysis, the time to an event (such as failure or death) may only be observed within a certain period, leading to truncated data. Similarly, in econometrics, income data might be truncated at certain thresholds due to reporting limits. In these cases, adjusting the likelihood function for truncation allows for more accurate parameter estimation and better model fitting.

Similar threads

Replies
1
Views
982
Replies
3
Views
2K
Replies
16
Views
5K
Replies
28
Views
6K
2
Replies
39
Views
11K
Back
Top