Putting upper bounds from a null result

In summary, "Putting upper bounds from a null result" discusses how to derive upper limits or constraints on certain parameters or phenomena based on experiments or studies that yield no significant results. It emphasizes the importance of analyzing null results to inform future research, improve experimental design, and guide theoretical predictions. The paper highlights methodologies for quantifying these upper bounds and their implications for understanding various scientific inquiries.
  • #1
kelly0303
580
33
Hello! If I have a measurement of a (dimensionless) parameter, ##a##, say 998 +/- 3 and the theoretical prediction of that parameter (assuming known physics) is 1000 +/- 4. Let's say that I want to set limits on a new parameter (not included in the theoretical calculations), call it ##\alpha##, that would contribute additively to ##a##. By comparing the experiment with the theory, I get a = 2 +/- 5 (the errors are all gaussian and I added them in quadrature). I want to set, let's say, a 95% upper bound on the value of a. In general, I could just say a < 12. However, in my case I know that ##a## has to be positive. How would I define the upper bound in this case, knowing that part of the range allowed by a = 2 +/- 5 is in practice not allowed by the physical theory? Also, I am not totally sure if my range would be (1000-998) +/- 5 = 2 +/- 5 or (998-1000) +/- 5 = -2 +/- 5. How do I decide which one to use. The first one would be the conservative choice, but I am not sure if it is not too conservative). Thank you!
 
Physics news on Phys.org
  • #2
kelly0303 said:
the errors are all gaussian … I know that ##a## has to be positive.
I don’t see how this is possible.
 
  • #3
Dale said:
I don’t see how this is possible.
I am not sure I understand
 
  • #4
kelly0303 said:
I am not sure I understand
How can it be true both that the errors are Gaussian and also that they must be positive? The Gaussian distribution is not strictly positive.
 
  • #5
Dale said:
How can it be true both that the errors are Gaussian and also that they must be positive? The Gaussian distribution is not strictly positive.
The errors on the theoretical calculations and on the measurement are Gaussian. The value of the new physics parameter must be positive. For example, the experimental value can be from a simple counting experiment. If the measured value is, say, 10000 and (I ignore the systematic uncertainties) the statistical error (assuming a Poisson process) is 100 (and it is very close to a Gaussian distribution) i.e. the measured value is 10000 +/- 100. The theoretical value can be, for example also 10000 +/- 100. Now I want to use this measurement to set upper bounds on a possible (positive value) new physics effect, given that its effect was not big enough to make the experiment deviate from the theoretical predictions (which don't include the new physics effect). I can share several papers where this is applied to some measurements if my explanation is not clear. Thank you!
 
  • #6
Theoretically, the errors on the measurement of a positive parameter cannot be gaussian, because gaussians can be unboundedly negative. That said it's common to just ignore this and use a bunch of math that assumes gaussians are errors, and somehow by magic everything is basically correct anyway in a lot of examples.

Here you know it's not magically correct, which means if you want to say something mathematical, the details of exactly what you did are going to be important.
 
  • #7
Office_Shredder said:
Theoretically, the errors on the measurement of a positive parameter cannot be gaussian, because gaussians can be unboundedly negative. That said it's common to just ignore this and use a bunch of math that assumes gaussians are errors, and somehow by magic everything is basically correct anyway in a lot of examples.

Here you know it's not magically correct, which means if you want to say something mathematical, the details of exactly what you did are going to be important.
But how do I do this in practice? Basically in my case I have a measurement and a theoretical calculation with gaussian errors. These values are from literature, so there is not much I can do about it. I want to test a new physics scenario which changes the expected results in a given way that depends on a parameter that needs to be positive. So the effect of this new physics can be written as ##k\alpha##, where ##k## can be calculated (we can ignore the uncertainty on k and assume it's just a constant) and ##\alpha > 0##. How do I use these (experimental and theoretical values and uncertainties, as well as k) to set an upper limit on ##\alpha## (assuming that the theory and experiment are consistent within uncertainties). Thank you!
 
  • #8
It would help if you had more specifics about what you're doing. There also might be field standards techniques that you should be using.

Here's an example of a thing I might personally do. Let's suppose I have a 100 meter track and I use a radar to measure the speed of something traversing the track at constant speed. My radar gun says that it is traveling at ##20 \pm 3## meters per second. I want to think about this in terms of time traveled. Obviously if it's 20 on the nose it took 5 seconds to travel the whole length.

The stdev of 3 means there's a 95 percent chance that we're within 2 stdevs and hence the speed is in ##[14,26]##. This means the time it takes, with 95 percent probability, is in the interval ##[3.84,7.14]## seconds (100/26 and 100/14). Note this is not symmetric around 5. You might be able to do something similar where you construct a confidence interval for what the final parameter is
 

FAQ: Putting upper bounds from a null result

What is an upper bound in the context of a null result?

An upper bound in the context of a null result refers to the maximum value that a parameter of interest can have, given that no significant signal was detected in an experiment. It represents the limit within which the true value of the parameter is likely to lie, based on the data and the statistical analysis performed.

How do you calculate an upper bound from a null result?

To calculate an upper bound from a null result, one typically uses statistical methods such as confidence intervals or Bayesian inference. This involves analyzing the data to determine the range of parameter values that are consistent with the observed lack of signal, often using likelihood functions or posterior distributions to derive the upper limit at a specified confidence level (e.g., 95% confidence level).

Why is it important to establish upper bounds from null results?

Establishing upper bounds from null results is important because it allows scientists to constrain theoretical models and hypotheses. Even when no signal is detected, upper bounds can provide valuable information about the properties of the system under study, ruling out certain parameter ranges and guiding future research efforts.

What are the common challenges in setting upper bounds from null results?

Common challenges in setting upper bounds from null results include statistical uncertainties, background noise, and systematic errors. Accurately accounting for these factors is crucial to ensure that the upper bounds are reliable and meaningful. Additionally, the choice of statistical method and the assumptions made during analysis can significantly impact the resulting upper bounds.

Can upper bounds from null results be improved with more data?

Yes, upper bounds from null results can often be improved with more data. Increasing the amount of data can reduce statistical uncertainties and improve the sensitivity of the analysis, potentially leading to tighter (lower) upper bounds. Additionally, better experimental techniques and more precise measurements can help in refining the upper bounds over time.

Similar threads

Replies
7
Views
2K
Replies
0
Views
1K
Replies
56
Views
3K
Replies
4
Views
1K
Replies
2
Views
8K
Replies
2
Views
2K
Replies
30
Views
3K
Replies
1
Views
1K
Back
Top