- #71
- 19,572
- 10,377
Mining what and looking for what?WWGD said:Do you think it would be worthwhile mining them?
Mining what and looking for what?WWGD said:Do you think it would be worthwhile mining them?
Just doing some regressions to find proxies for good posts, e.g., patterns of traits that seem to correlate with highly -rated posts. Or maybeGreg Bernhardt said:Mining what and looking for what?
WWGD said:Just doing some regressions to find proxies for good posts, e.g., patterns of traits that seem to correlate with highly -rated posts. Or maybe
logistic regression, which assigns a probability ( of a post being high -quality) from given traits? I am not 100 % , but AFAIK, this is done in many
corporate settings, maybe can be adapted here?
I don't mean to be pushy, but is it possible to somehow set aside posts that are good in order to be analyzed? I know mentors are already overworked,micromass said:I don't think we have that much data...
Feedback and suggesting are good. How would you analyze/evaluate a post?WWGD said:I don't mean to be pushy, but is it possible to somehow set aside posts that are good in order to be analyzed? I know mentors are already overworked,
so maybe this can be done gradually until a relatively large amount of data is available?
Maybe a combination of numbers: one of them is a measure of satisfaction with answer by OP, others are measures by mentors of : originality, quality, opening up new avenues, good example. Say from 0-5. Then we can average the measures given by all mentors and select those with, say, score from 4-5 as the good ones and those in 0-1 as the worse ones and look for patterns, for qualities . Maybe we can also link to these from the main page to illustrate what we consider to be quality posts. These types of analyses are done at corporate level under the general term " metrics" with, e.g., measures of product satisfaction.Greg Bernhardt said:Feedback and suggesting are good. How would you analyze/evaluate a post?
Identifying good posts is not hard, what is hard is developing an automatic system. Companies spend millions to develop such technology and I think it's likely beyond our capabilities. Furthermore I'm starting to get lost on the purpose of this. Is it to teach people to write good posts or to list good posts for people to read? And are we talking about good posts or good threads. We already have the featured thread area. I don't think linking random good posts from various points in different threads would be cohesive.WWGD said:Maybe a combination of numbers: one of them is a measure of satisfaction with answer by OP, others are measures by mentors of : originality, quality, opening up new avenues, good example. Say from 0-5. Then we can average the measures given by all mentors and select those with, say, score from 4-5 as the good ones and those in 0-1 as the worse ones and look for patterns, for qualities . Maybe we can also link to these from the main page to illustrate what we consider to be quality posts. These types of analyses are done at corporate level under the general term " metrics" with, e.g., measures of product satisfaction.
We do have measures to inform members if we think their post is low quality. Unfortunately given human nature and the flighty nature of online communities it's very difficult to actually make big gains in post quality. The best way is to simply find a way to attract those who just already have it. Those low post members aren't going to be very receptive and suddenly turn into journal quality writers.WWGD said:I would say the idea , or at least an idea is to get people to write better posts and to allow mentors, others, if possible,to steer low-quality posts up into better ones by having a better idea of the traits to identify as being conducive to better quality. This way creating a positive feedback loop of motivation and quality posts. And, yes, another measure of quality would be the "liking" .
Greg Bernhardt said:We do have measures to inform members if we think their post is low quality. Unfortunately given human nature and the flighty nature of online communities it's very difficult to actually make big gains in post quality. The best way is to simply find a way to attract those who just already have it. Those low post members aren't going to be very receptive and suddenly turn into journal quality writers.
These are supposed to be used more as rules of thumb than as deterministic rules. To help guide, but can always be overruled if the context suggests the rule does not apply.DaveC426913 said:The idea of assigning some objective quantity of "goodness" to posts raises some alarm bells in my head.
Seems to me, the spirit of scientific inquiry is a democratic and merit-based one. An inquistive mind should read as much as possible before drawing a conclusion as to what the most helpful or wise answer is. A goodness rating - especially an automated one - interrupts that, and inches us down the slippery slope of the "appeal to popularity" and "appeal to authority" fallacies.
I think it will damage PF.
I'm afraid I don't see how that alters my point at all. Popularity is a snowball effect. A nobody writing a good post isn't enough anymore, now they also need a 'reputation' to be heard over the 'high goodness score' people.WWGD said:These are supposed to be used more as rules of thumb than as deterministic rules. To help guide, but can always be overruled if the context suggests the rule does not apply.
DaveC426913 said:I'm afraid I don't see how that alters my point at all. Popularity is a snowball effect. A nobody writing a good post isn't enough anymore, now they also need a 'reputation' to be heard over the 'high goodness score' people.
DaveC426913 said:The idea of assigning some objective quantity of "goodness" to posts raises some alarm bells in my head.
Seems to me, the spirit of scientific inquiry is a democratic and merit-based one. By merit, I mean 'any good post' as opposed to 'someone who has a high goodness score'.
An inquisitive mind should read as much as possible before drawing a conclusion as to what the most helpful or wise answer is. A goodness rating - especially an automated one - interrupts that, and inches us down the slippery slope of the "appeal to popularity" and "appeal to authority" fallacies.
I think it will damage PF.
But again, this is intended to serve as an aide, not as a substitute for judgement.atyy said:We are always on this slippery slope (for example, we already have mentors and science advisors), but I do agree with the spirit of your post.
Reddit is the most common website visited immediately prior hitting PF (aside from google).DaveC426913 said:PF is trying to "compete" with Redditt??
And alexa data is near useless because it relies on people using their toolbar, which is about exactly no one.mfb said:I don't know the timescale they use for the analysis. That number could be a bit biased from the nearly 400,000 hits this article got from being on the reddit front page recently.
At the risk of sounding trite, the road to heck is paved with good intentions.WWGD said:But again, this is intended to serve as an aide, not as a substitute for judgement.
I don't intend to force, nor pressure anyone to accept this, but you can design a measure that takes these issues into account.DaveC426913 said:At the risk of sounding trite, the road to heck is paved with good intentions.
What it is 'intended' to do is meaningless. The issue is how will it be used. And PF has little control over that.
PF can't prevent posters from saying 'Your best answer is over here. Listen to this guy instead'.
PF can't prevent people from simply stopping with discussions, and preferring what they think is The One True Answer.
PF can't prevent low-rep posters from feeling intimidated into not posting.
Well, that's the question that's on the table, isn't it: Can you design a system that helps rather than hinders? Help what? Hinder what? You wouldn't know if you had until you saw it working.WWGD said:...you can design a measure that takes these issues into account.
I will try to come up with something more concrete to illustrate my idea.DaveC426913 said:Well, that's the question that's on the table, isn't it: Can you design a system that helps rather than hinders? Help what? Hinder what? You wouldn't know if you had until you saw it working.
I think the first hurdle, which is one of the things that triggers my alarms, is:
What exactly is the intent here? Define what it is intended to accomplish, specifically with reference to what PF is about (a place for answers, yes, but also for discussion).
Let me set up a situation. Let's set aside the 'how', let's say it is magic. As a user with a question, I press the Big Red Button, and what happens? I am taken to The Answer?What if this became so successful that we managed to post a definitive answer for every question asked to-date? Would PF become simply a physics-Wiki with post-traffic dropping precipitously? Is that a successful outcome?
Physics in general does need to get some mojo backmkay said:but it probably comes down to fewer people being interested in physics
I've learned not to doubt the minds at Google. Who searches for bread anyway :Dmfb said:
You have a very interesting forum, Joe/Jane we (a nobody) has no easy access to ask questions of Science (unless we are in some sort of school) and you guys have experts that answer those questions. And reading through them every one has a different way to state the same fact, (Helps a lot). Some guys use simple words and very direct, others could come from top to bottom a bit more complex for my taste. At the end you guys helped someone.DaveC426913 said:Well, that's the question that's on the table, isn't it: Can you design a system that helps rather than hinders? Help what? Hinder what? You wouldn't know if you had until you saw it working.
I think the first hurdle, which is one of the things that triggers my alarms, is:
What exactly is the intent here? Define what it is intended to accomplish, specifically with reference to what PF is about (a place for answers, yes, but also for discussion).
Let me set up a situation. Let's set aside the 'how', let's say it is magic. As a user with a question, I press the Big Red Button, and what happens? I am taken to The Answer?What if this became so successful that we managed to post a definitive answer for every question asked to-date? Would PF become simply a physics-Wiki with post-traffic dropping precipitously? Is that a successful outcome?
When mfb said,Greg Bernhardt said:I've learned not to doubt the minds at Google. Who searches for bread anyway :D
he wasn't considering this.
... Science Colloquium, students explored the chemistry, microbiology and physics involved in transforming seed into bread ...
You are referring, I think, to what is visible for the public; however in addition to that, such things also happen invisibly for the public. My participation is slowly reducing and just now I am (again) considering to abandon PF entirely, simply because the mentoring process is flawed. It's too optimistic to assume that mentors will participate in discussions without abusing their powers. In reality, discussions are often(?) misleading as they are invisibly manipulated (edited) to express the views of participating mentors by means of deletions of inconvenient posts (even statements of facts!) and/or thread locking at a convenient point. In view of another fresh disappointment along these lines, I now think that it may be better to stop supporting this forum, regretfully. I know of several high quality participants who experienced the same but who were more assertive than I am, so they got simply kicked out. The end result is the same: less high quality participants.gravenewworld said:Go ahead and look at my profile, I've been around here for over 10+ years. Increasingly I find myself checking PF less and less. We've lost wildly popular and famous posters over the years. Why is this happening? Is it just me or does there seem to be less and less traffic on PF? I remember when the general forum (and many other subforums) used to have almost all new threads on the first page within a day or two, now there are still threads from Aug. on the 1st page and almost as many locked threads as ones still open.
I dunno, but personally I've found this place often times becoming too abrasive and too toxic. [..] why is there the need to close threads and give a verbal smack down?
[..] if a thread or discussion annoys or bothers you, why not just ignore it instead of locking it? As a long time member, lurker, and poster here, I just feel like rule with the iron fist is backfiring (and this is where I expect the deluge of posts from the PF upper echelon members to start giving responses tantamount to something like 'rules are rules, if you don't like it you can leave or be banned'). [..] if I got some of the responses to some of my posts then as what I see posted now, I would definitely be rubbed the wrong way and would never return to this place ever again or would be discouraged from even making a new account if I were a lurker. What can be done to improve traffic, thread creation, and discussion volume and for more people to check this place more often? I don't want to sound like a hate or anything, but I mean come on, it only takes 2 seconds to check what the webtraffic and the global website ranking history has been over the years and it has steadily declined. My $.02.