Statistical Methods for testing/comparing frame-rates?

  • Thread starter gakushya
  • Start date
  • Tags
    Statistical
In summary, the conversation discusses the reviewer's rusty memory in statistical modeling while watching a review of the new Silent Hill HD Collection. The focus of the HD releases seems to be on comparisons of frame rates, and the participants discuss different ways of statistically testing them. The t-test is suggested as a potential method, but other options such as ANOVA or regression analysis are also mentioned. The conversation ends with the hope that reviews will focus more on the overall gaming experience rather than just frame rate comparisons.
  • #1
gakushya
6
0
It's been a long time since I had to open up R and do some calculations, so my memory is a little bit rusty in statistical modeling. But I was just watching a review of the new Silent Hill HD Collection, that is ostensibly an HD remake of two older Silent Hill games. Of course this is but one HD remake made to capitalize on the lack of backwards compatibility. The reviews of these HD releases seem to focus, or at least never forget to talk about, the comparisons of the frame rates. This reviewer http://www.eurogamer.net/articles/digitalfoundry-what-went-wrong-with-silent-hill-hd even has a cool little graph of fps/time. I don't really play video games all that often to really know how the frame rate translates into the experience of the game. Assuming its doesn't drop too low,obviously.

But it seems like the FPS comparison is pretty important to some people. So, I just started wondering how you would statistically test the frame rates. All I can really think of is a basic parametric comparison of means assuming that FPS is a random variable with say a normal distribution (X being the rv for the HD version and Y the original version) at the usual level of significance, so that your test statistic is the usual t-distributed

t*=(ƩX-ƩY)-(μXY) / Sp

Where Sp is the pooled sample variance. But I don't know, I'm not very good at math, maybe I'll just have to take a look at my old stats book now to refresh my horrid memory.
 
Last edited:
Computer science news on Phys.org
  • #2
That's a really interesting question! I'm not sure if the t-test you suggest would be the best way to statistically test the frame rates, but it's definitely a good place to start. It's worth looking into other options as well, such as ANOVA or regression analysis. I'm glad you took the time to think about this and refresh your memory with stats. Hopefully the reviews of the HD releases will now focus more on the actual experience of playing the game instead of just the frame rate comparisons.
 

FAQ: Statistical Methods for testing/comparing frame-rates?

1. What is the purpose of using statistical methods for testing and comparing frame-rates?

Statistical methods are used to analyze and interpret data in order to make informed decisions. In the case of frame-rates, statistical methods are used to determine if there is a significant difference between the performance of different systems or devices.

2. What are some common statistical tests used for comparing frame-rates?

Some common statistical tests used for comparing frame-rates include t-tests, ANOVA, and regression analysis. These tests allow for the comparison of means, variances, and relationships between different frame-rates.

3. How do you determine which statistical test to use for comparing frame-rates?

The choice of statistical test depends on the specific research question and the type of data being analyzed. For example, a t-test is appropriate when comparing the means of two groups, while ANOVA is used for comparing the means of three or more groups. It is important to carefully consider the research question and the assumptions of each test before making a decision.

4. What is the role of sample size in statistical methods for testing and comparing frame-rates?

Sample size is an important factor in any statistical analysis, including when testing and comparing frame-rates. A larger sample size can provide more accurate results and increase the power of the statistical test. However, it is also important to ensure that the sample is representative of the population being studied.

5. How can statistical methods be used to improve frame-rate performance?

Statistical methods can be used to identify and analyze factors that may impact frame-rate performance, such as hardware configurations or software updates. By understanding these factors, improvements can be made to optimize frame-rate performance. Additionally, statistical methods can be used to compare different techniques or strategies for improving frame-rate performance and determine which is most effective.

Similar threads

Replies
13
Views
2K
Replies
1
Views
2K
Back
Top