22

October 30th, 2023

As we are not seeing anything that needs to be debated at this point in time. I am going to accept the answer I proposed to the community. Of course, this policy doesn't need to be permanent, and if the community believes it should be updated and changed, it is welcome to do so through regular community discussion.

Update October 20th, 2023

The answer below is a good-faith effort at combining the two most highly upvoted answers received during this exercise. I had several CMs review to make sure they thought it was sufficient.

Please take a look and decide if you find the answer satisfactory. If not, we can create a chatroom to discuss what changes we need to make to get it over the finish line.

This discussion period will stay open till October 27th, 2023. However, we can extend if necessary.


Update October 5th, 2023

Thank you to everyone who weighed in with answers or comments. We got a lot of good input. We have a few different upvoted answers that are categorically similar but bring up some good points.

To avoid any debates on this matter in the future and put it to rest the CM team will review what has been shared and craft an agreeable policy from these, and then share that with the community here.

You can expect to see that by October 20th at the latest, but we hope to have that completed earlier than that.


The Web Applications Stack Exchange site is in an interesting position regarding the topic of showing research has come up several times over the past years. As a community manager, I wanted to give the discussion a fresh start to help the community come to a consensus. However, if we can not reach a consensus as a community, I will discuss it with a few CMs to come to an agreement for a site policy to put it to rest.

To set the stage, I see two perspectives after reviewing past discussions on the matter:

  1. Little to no research is required

    Support of this viewpoint is under the premise that question asking on web apps is to seek help first and that imposing research requirements might discourage users from asking questions. Closing questions should be based on their lack of context and clarity, rather than a lack of research. They believe that not requiring research creates a welcoming environment, especially for new users, and allows for more active participation.

  2. Demonstration of Research Efforts

    On the other hand, requiring research argues that providing context about what has been tried and where the user is stuck is more beneficial than simply asking a question. This not only helps in a better understanding of a question but will also prevent duplication of efforts by the answerer. Showing research can make a question more engaging and relevant while giving it better odds of receiving a response and participation from the community. Questions that do not demonstrate research effort appropriately should then be considered for closure. However, it might encourage new askers not to ask due to the higher bar for participation.

The Ask

Given the previous discussion on research in the web application community, I would like to pose the question to you all: What level of research needs to be demonstrated for a question to be acceptable?

Furthermore, should it become a requirement for users to show some level of research, like searching the help center of the web application in question before posting it? How best should that be demonstrated, and to what degree, if any, must it be established?

We will leave this open for community input for four weeks and stop considering feedback to the question on October 5th, 2023. After that point, if there is overwhelming support for one option, we will adopt that as policy. If there is not, the CM team will craft something sensible between all suggestions offered and existing network norms.

12
  • 2
    Are we allowed to leave comments on the answers to discuss the answers? I see that the comments on Journeyman Geek's answer got removed. (archive.org) Commented Sep 14, 2023 at 21:31
  • 5
    @FranckDernoncourt Yes, you are, but I would stick to clarifying positions rather than trying to debate someone else's answer.
    – SpencerG StaffMod
    Commented Sep 22, 2023 at 16:55
  • 5
    Hi Spencer, what do you mean there is no overwhelming support? There is an overwhelming support. The two answers that stated that research is not required got a score of 14 and 12, which are the two most upvoted answers of this entire Meta for the past 1 year (AFAIK). Meanwhile, the 5 answers that stated that research is required got a score of 5, 1, 0, -1, -2. It clearly means that the community consensus is that research is not required. Why do you say there is no clear community consensus? Commented Oct 5, 2023 at 20:06
  • 1
    @FranckDernoncourt I see three upvoted answers that are all similar but have some different angles. I would like to encompass the highly upvoted ones in an agreeable way and have that be the de facto answer for Web Apps. I will edit my update so that is clear.
    – SpencerG StaffMod
    Commented Oct 5, 2023 at 20:54
  • 2
    Thanks, I see. The 3rd upvoted answer has a score of 5, which is way lower than 14 and 12 for the top 2 upvoted answers. And we shouldn't ignore the other answers, whose low scores indicate that the community doesn't favor adding the research requirement. Commented Oct 5, 2023 at 21:24
  • 6
    @SpencerG I would like to point out that the community disagrees with the moderators who have been closing questions for lacking research. This is evident from the answer scores here. The two moderator answers (one deleted) that support mandating research have negative scores. And the two answers that oppose mandating research have a score more than twice that of the answers that suggest mandating research. This is consistent with the voting in the several previous meta posts on this topic. I hope that the final policy will reflect the community’s consensus on this matter. Commented Oct 7, 2023 at 1:55
  • 2
    @SpencerG Wouldn't it make sense to have the policy be that research isn't required, but then heavily encourage it wherever possible? For example, JG's suggestion seems like it would be a good start for the Ask Question popup.
    – Laurel
    Commented Oct 7, 2023 at 14:12
  • 2
    Thanks, it may be preferable to extend the October 27th deadline as we have yet to see moderators will interpret and implement your answer, e.g. How shall we request the reopening of questions closed due to lack of research?. As closed questions are nominated for reopening, it may raise some additional questions on your answer. I've only nominated one closed question for reopening so far because after my 4 bans this year I live in fear of getting banned, but once the moderators approve the nomination protocol, I'll nominate more questions. Commented Oct 26, 2023 at 7:15
  • 2
    @FranckDernoncourt I am not concerned about mods not following this policy for Webapps. The mods have acknowledged it which is sufficient for me, if it becomes an issue we can cross that bridge when we get there.
    – SpencerG StaffMod
    Commented Oct 26, 2023 at 13:18
  • 1
    @FranckDernoncourt If new questions arise from nominated closed questions we can address that on a case-by-case basis. If you are anticipating some questions on that already please do bring it up.
    – SpencerG StaffMod
    Commented Oct 26, 2023 at 13:19
  • 2
    @SpencerG Thanks for writing this meta discussion post and the site policy that resulted from it. What are your suggestions on how we can collaborate as a community to implement this site policy and reopen the questions that conform to the community consensus? I saw that there is a meta discussion post here where the community is organizing this effort, but it has been closed and locked by a moderator. Commented Nov 5, 2023 at 4:31
  • Relevant Meta Stack Overflow post: Do we need a close reason for zero-effort questions? Commented Jan 21 at 1:38

8 Answers 8

19

Downvotes, not close votes, for bad poorly researched questions

I've been on a lot of sites, and this is what I've seen work the best. And even then, downvotes are reserved for the questions that could have been solved very quickly and easily by pretty much anyone (as we're not all experts), not challenging problems that are brief only because they don't include OP explaining that they're getting nowhere fast. (On a site like this with such a wide breadth, it can be hard to tell these types of questions apart, especially when there are no answers yet. That's one of the reasons why both should stay open.)

To be clear, I think that it's usually a good idea for users to do at least a little searching before asking, especially when they're likely to be downvoted if they don't. It just doesn't need to be a requirement. (Obviously, if your question was already asked here, it will be closed as a duplicate, but that's not quite the issue at hand.)

To better understand my reasoning, let's use What do the red dashed lines mean in Google Maps? as an example since I've already spent a bunch of time on it (see also Reopen "What do the red dashed lines mean in Google Maps?").

The state of documentation

For most of the web apps I use, I have no idea where the documentation is, and the documentation that's out there is often... not good. If I can't figure something out by myself, I search the internet for the answer.

Google Maps has next to no internal documentation (that is, interacting with the website interface does not explain much—in this case there is no map key). When I try to search for the external Google Maps documentation, I instead get the documentation for developers and Google Map Platform (for businesses), both of which may look potentially relevant from the search results but aren't. It's not until I search for the help that I get a relevant hit which has the information for users of the website and apps. However, it doesn't bear fruit. Searching for different combinations of "lines" or "red" turns up nothing. Going to several of the relevant articles and expanding the accordions manually (ugh, collapsed accordions) also brings up nothing relevant. I don't think the answer is in there, but I didn't read everything (and shouldn't be expected to).

When I tried to find the answer for this via a Google search, I found conflicting results:

  • What does the red Dotted line around some landmarks (beaches ) mean?: "The red dotted line represents the extent of the beach." (This is only correct in the thread it was asked in; in our example, the circle is around the entire island, not just the beach)
  • What does the red dotted line mean on roads, e.g., M25 J27 now?: "Currently experiencing Moderate to Extensive delays" (This is a different red dashed line)
  • "The dotted line is not directions. It just indicates that you can’t get to the destination by car so it brought you to the closest place and you’ll have to walk the rest of the way. The dotted line is not walking directions but I guess I can see the confusion." (Yet another line)
  • Twitter: "Google Maps has a red dashed line around Crimea, btw -- I assume to indicate it's disputed territory." (Right line, wrong answer)
  • Many more results, most of which are about other lines. (How many different types of red dashed lines are there? Am I even looking at results for the website?) I didn't see the right answer.

Now, there is one result that could have solved the problem in an instant. It's the link to the question on Webapps, which currently ranks #2 on my search. I could point out all the ways that we can be better than the other sites on the internet (ranked answers! no chatter! edits!), but since you're already this deep on Meta I'll assume you don't need to hear all that.

Research requirements as an obstacle for experts

Writing the answer to the question would have taken less time than even finding the official help for the website, much less searching through that, or writing about it, or the other searches I did. Also, to be brutally honest, I don't care about this research. It's only making it a longer scroll down to the bottom of the post to either post an answer (we all might already know the documentation sucks), or to see what the answer is (we're not here for distractions!), depending on why you're looking at the question. Hyperbole aside, the point is that it doesn't help a potential answerer get closer to the answer. And if you're the one who's expected to do all this research, you're probably looking for another site to participate on next time instead, if you don't just decide to settle for whatever wrong or suboptimal answers you can find in Google.

Even before writing all this, I've already put too much effort into reopening this one question. Looking at meta, I think I'm not alone. I also get the feeling that moderators are similarly spending a lot of time; since they are the ones who close the questions, they're the ones who have to answer inquiries about how to reopen them from all directions, including meta. We could use the time that we're currently spending closing and reopening these questions on other matters, like answering questions.

Let the experts fill in the gaps

I think it's also relevant to discuss questions that don't include all the relevant details to solve. It's only natural; people who ask questions typically don't know the answer, so they often won't know what additional details to add or factors to consider. It might be tempting to close some or most of these questions as needing more details and barrage them in the comments asking about various minutiae. However, that's not the only option, and in most cases it's not the best option.

An expert knows the caveats of different approaches. Instead of asking a lot of questions (e.g., "Mac or Windows?"), experts give thorough, wiki-like answers that let the reader know the pros & cons and decide what solution works best for them, and also work no matter what setup the reader has ("This way on Mac, a different way on Windows"). And, if all goes right, they help people other than the person who asked the question.

3
  • 8
    @Rubén The very first header seems to answer that directly. You ask, “What level of research needs to be demonstrated for a question be acceptable?” The first section of this answer pretty clearly indicates that downvoting, not close voting, is the appropriate curation tool when little to no research effort is presented. Commented Sep 10, 2023 at 19:46
  • 7
    @Rubén Again, to me this answer presents a very straightforward answer to “clarifying the research requirement”. Would you prefer that it more explicitly stated “there should be no research requirement”? Commented Sep 10, 2023 at 20:21
  • 8
    @Rubén I don’t see how this answer is "derailing" the discussion. The question is tagged with [moderation], so it clearly involves moderation matters as well. It seems to me that it is within the scope of this meta discussion to talk about the possible moderation implications the discussion introduces. Commented Sep 13, 2023 at 7:23
15

No, we shouldn't make research mandatory.

Showing research effort is a good practice that we should promote among the community, but I think we shouldn't close questions that don’t show research. This would lead to the closure of most questions on this site, which would further reduce the participation and activity of our already small community.

Most of the questions on this site do not show research, as you can see by browsing through them. If the question is clear and understandable to anyone who uses the web app in question, then it should not be closed as "requires research" via the "needs details or clarity" close reason or any other close reason.

Here are some examples of questions that were closed for not showing research:

The issues stated in these questions are clear and understandable to anyone who uses Facebook or GitHub, respectively, and do not require further research to understand or answer them.

If we implement a "research required" policy, we might end up closing most of the questions on this site.

We should encourage more questions and answers instead of imposing more restrictions

A Stack Exchange site with very low activity and user participation does not need stricter question requirements. That would be counterproductive. More restrictions would only reduce the number of questions and answers that are welcome on this site, which would discourage both new and existing users from participating or contributing. This could lead to a downward spiral of declining activity and quality.

I propose that we focus on encouraging more questions and answers instead of imposing more restrictions. This way, we can foster a more active and lively community that can attract and retain more users and, ultimately, enhance the quality and relevance of the site.

6
  • 8
    I would say that retroactively closing questions based on the new expectations seems like a poor decision on its own. If the question is totally out of scope, that's one thing but to have question quality expectations change years later, closure of these old, well-received questions seems like an overreach. For example, on Movies, when ID questions were made off topic, it made sense to close all existing ID questions but FB is not off topic here, this question merely fails to meet a changed standard of quality. I don't see why closure makes sense in this situation.
    – Catija
    Commented Sep 11, 2023 at 21:40
  • 8
    If there's an urge to force questions to meet such standards (which the answers here don't seem to indicate anyway), the better option is to edit the questions so they can be a better indication of quality expectations rather than close them. But at that point it seems like you're adding unnecessary filler that may be beyond the OP's intention just to meet a policy, which begs the question of whether the policy makes sense at all.
    – Catija
    Commented Sep 11, 2023 at 21:44
  • 6
    @Rubén any policy discussion must include work to understand the full scope of any decision. If a research policy is being discussed, it's fair to include discussion of what should happen to old questions that fail to meet said guidelines. Deciding policy without these considerations is likely to lead to a decision that is based on a poor understanding of the impact of such a policy. To be honest, I find it's quite concerning that so many of the points being made are being invalidated by your extremely narrow reading of the question,
    – Catija
    Commented Sep 29, 2023 at 17:30
  • 4
    It's fair to have different methodologies but I don't know that I've heard of a discussion format that excludes discussion of how to support a decision. For example, say I own an apple orchard. I want to decide whether to change half of the trees to orange trees. When deciding whether to do this, it's worth considering the cost and impact of removing the old trees and also understanding the cost of planting orange trees, the time they take to start producing, learning how to care for oranges and what to do if the orange trees die because it's the wrong climate.
    – Catija
    Commented Sep 29, 2023 at 18:40
  • 5
    How can one do an effective job of determining whether orange trees are a good idea if they only consider whether they like how oranges taste? @Rubén can you help me understand this? Why is discussing what would be done with the historical questions that no longer meet the policy out of scope? Surely understanding the impact is important because the older content is still important for the site and the value it adds. It's also a potentially huge amount of work to close/delete/edit/lock the questions and worth considering within this discussion.
    – Catija
    Commented Sep 29, 2023 at 18:45
  • 2
    @Rubén Catija's comments are very pertinent to this discussion. One of the main reasons that led to the community managers starting this meta discussion in the first place was because of several community members' concerns about the closure of several old, well-received questions. We should be able to discuss here how the policies we suggest affect the moderation of these old questions. After all, this meta post has the [moderation] tag, so it clearly involves moderation matters. Commented Sep 30, 2023 at 1:38
9

As demonstrated by the community, including research in a question is not required for question asking on Web Apps.

While it can certainly be helpful to include your research in a question, it's not strictly necessary for a good question to be asked. A lack of present research does not cause a question to be unsatisfactory.

Good, high-quality questions can be written in many different ways. Demonstrating research could be one way to write a question of adequate quality, but this could also be done by ensuring your question is specific, has appropriate context, and what efforts you have made to resolve your problem or what you have done. Generally speaking, the guidance offered here makes up a good question.

How should the community handle questions they don’t like?

Considering the above, close votes for lack of research won’t be necessary. Otherwise, standard close reasons still apply.

Regarding downvoting, individuals can still make their judgment calls of quality and downvote as they wish. To be clear, no policy requires users to downvote instead of a close vote. Community members across the network are welcome to cast close votes for legitimate reasons and downvote as they see fit.

What does this mean for questions closed for reasons based on showing research?

Since we are removing a barrier to question-asking, new questions don’t need to be closed. However, closed questions can be reopened should they otherwise be of an adequate standard for Web Apps. If the only reason for a question's closure was due to a lack of research, it would qualify to be reopened. Otherwise, the question would still require revision to meet Web Apps’s standards for question-asking.

On more basic questions

Web Apps, like any other site across the network, is a library of knowledge. A library would be otherwise incomplete if it didn’t meet the needs of all levels of expertise. This, however, isn’t an invitation for the most basic of questions: Web Apps shouldn’t replace a bare minimum reasonable effort to locate an answer to a question, and sometimes a lack of research may be an indicator of extremely low quality, such as something like, “How do I open a Gmail account?” or “How do I add a friend on Facebook?”. Questions that would reasonably be answered by simply opening the tool don’t belong on Web Apps, as the site is not a helpdesk. However, questions that would reasonably be confusing to a beginner who has made the most basic level of effort to understand the issue are welcome. Libraries are at their best when they contain the knowledge that can allow an individual to go from a beginner to an expert. WebApps is no different than any other knowledgebase we hope to build across the network, to provide the resources to help beginners or experts become more knowledgeable in their subjects of interest.

5
  • 4
    I appreciate your answer and I’m glad that you and the CM team have taken the community consensus into account. Could you please add the [faq] tag to this question so that it can serve as a policy reference for users? Commented Oct 21, 2023 at 0:52
  • 2
    @SpencerG Sounds great! Nice job!
    – Blindspots Mod
    Commented Oct 23, 2023 at 6:20
  • 1
    Thanks. 1) "Demonstrating research could be one way to write a question of adequate quality, but this could also be done by ensuring your question is specific, has appropriate context, and what efforts you have made to resolve your problem or what you have done": doesn't "what efforts you have made to resolve your problem or what you have done" mean that the OP must show some type of research in the question? 2) How shall we request the reopening of questions closed due to lack of research? Commented Oct 26, 2023 at 7:11
  • 2
    @FranckDernoncourt I am not trying to make it a requirement for users to show research. This section is intended to give guidance to users on different things they could do to ensure their questions have enough information to be answerable. That doesn't mean they have to do one of these things, but it would increase their chances of getting an answer. If you have alternative text to communicate please do so.
    – SpencerG StaffMod
    Commented Oct 26, 2023 at 13:15
  • 1
    @SpencerG "what efforts you have made to resolve your problem or what you have done" is "Demonstrating research". If I understood your comment, this would make a better text: Demonstrating research could be one way to write a question of adequate quality - this could be done by ensuring your question is specific, has appropriate context, and what efforts you have made to resolve your problem or what you have done (removed but and also). 2. It's unclear what your recommendation is regarding questions like “How do I open a Gmail account?” - Closure? If so, on what closure reason?
    – TheMaster
    Commented Nov 7, 2023 at 20:06
4

To quote two of my favourite Franchises "All this has happened before, all this will happen again" and "Only a sith (or a developer) deals with absolutes"

The healthiest situation is between the two extremes. I also feel like there's also some other 'structural' issues at play here.

Quality answers need quality questions. In the early days there were a lot more low hanging fruit, and standards have evolved over time, and asking the first thing that comes to mind worked.

On the other hand, while I've been guilty of some deeply researched questions in the past (Its a fun rabbithole!) the point of showing your work is so others know where you've been, and what you've tried.

A good question is about clearly articulating your problem - in the old days, before I was a moderator, I used to post a comment going "We need more information to help others help you..."

I also feel like people overcompensate/maliciously comply with showing research.

I think a good starting point is

You should only ask practical, answerable questions based on actual problems that you face. Chatty, open-ended questions diminish the usefulness of our site and push other questions off the front page.

and

inspire answers that explain “why” and “how”

I am going to gank Laurel's example - "What do the red dashed lines mean?"

While I wouldn't give a long story of why I need to know this, knowing what practical problem this solves would be useful.

"I was looking at the island of Aneityum on google maps and noticed a red dashed line. This doesn't reflect any physical boundaries as per the satellite or map images, and it dosen't correlate to any physical boundaries. Google maps dosent' provide an obvious legend - what does this reflect?"

Would be a better start. If OP was going along the coast, and this reflected an intertidal region, it would probably be a matter of life and death.

You don't need a step by step guide to EVERYTHING. It just needs folks to show a little effort.

7
  • 2
    How does one decide if a question showed enough research? (not enough research shown = the question will get closed because of lack of research) Commented Sep 13, 2023 at 20:17
  • 1
    I would like to ask for clarification regarding your answer. I know you already said something about not dealing with absolutes, but essentially, the question posed is a yes/no question. Does your answer mean "yes, questions must show research, i.e., what practical problem they are attempting to solve; otherwise, they should be closed"? If that’s not what you meant, could you clarify if your answer is "yes" (and what the research criteria are) or "no"? Commented Sep 14, 2023 at 4:51
  • 2
    Sometimes the answer to a yes/no question is 'it depends'. I am saying questions should show some effort but not necessarily a deep dive into what was tried. Commented Sep 14, 2023 at 5:33
  • 2
    Not asking the first thing out of your head on one extreme, and not expecting your entire life story on the other. Insufficent research or more precisely lack of quality should result in downvotes on a healthy site - and the closures by mods are trying to mitigate the lack of that happening Commented Sep 14, 2023 at 5:43
  • 1
    @JourneymanGeek 1) I have never read anywhere that mods can close questions to mitigate the lack of downvotes. Where did you read that? 2) "Sometimes the answer to a yes/no question is 'it depends": A lack of a clear research requirement would result in the arbitrary closures of questions. Commented Sep 14, 2023 at 6:54
  • 2
    A drawback of an "it depends" policy is that it’s subjective and could leave a lot of room for misinterpretation and arbitrary closures based on personal opinion. A more preferable policy would be one that is objective, clear, and leaves no room for ambiguity, to prevent further disputes on how to interpret the policy. Commented Sep 14, 2023 at 8:21
  • 3
    Or for people to step back and try to find some common ground, or a better balance between the two. I've seen both what excessive strict moderation, and "eh, we really don't need people to show effort" and both are horrible. Commented Sep 14, 2023 at 10:01
3

The answer and the current policy confirmed by Spencer G fails to address the actual close reason. Any question, no matter how detailed, maybe construed as "lacking details or clarity".

It's important to note there is no close reason for "lack of research" and questions closed for "lack of research" is closed using the reason: "Needs details or clarity" as proxy:

Closed. This question needs details or clarity. It is not currently accepting answers.

Add details and clarify the problem being solved. This will help others answer the question. You can edit the question.

At its core, it is the work ratio, that most users are concerned about:

Work done by asker : Work needed to be done by answerer

You can call it lack of research, lack of detail/clarity or whatever, but you are essentially saying Work/effort done by asker is not enough compared to the work needed to be done by answerers. The work done by asker may be:

  • by researching the question - like providing searched links,
  • by making the question more clearer/detailed - like providing a copyable text table of Google sheets questions instead of just describing what's in each columns in paragraphs of text or providing a image
  • by attempts at solving the questions - like writing the code

This directly reduces the work needed by the answerer(s)

  • research: easy links to documentation or other resources for quick review
  • clarity/detail: effort needed to comprehend is greatly reduced as well as the effort needed to reproduce. If I can understand a question within 2 minutes, compared to say 5 minutes, that's 3 minutes of saved time. Copy pasting tables is easy compared to transcribing an image or deciphering the text data
  • attempts at solving the question helps to see exact pain points. I don't have to write the entire solution afresh, but just address specific issues.

There's also a human pride factor at play here: No one wants to work for someone else for free. The effort put forth by the asker is not only indirectly proportional to the work needed to be done by answerers, but also directly proportional to the respect they show the existing community or the answerers. That respect is a crucial factor. It's what makes this site run - and it translates to reputation. That is also what creates high quality repository of questions and answers.

If the work ratio is high, I'm inclined to react positively. If the work ratio is less, I'm inclined react adversely by close votes/downvotes. Coming back to the closure reason, What is clear to me may not be clear to someone else. What is less detailed to me maybe more detailed to someone else. What requires 10 minutes for me to understand may take 20 minutes for others and some may never understand. What is more work for me would be easy/less work for someone else.

Here's where consensus play an important role. If at least three users believe the question needs more detail/clarity, then we have consensus that the question lacks clarity. But if those with unilateral close privileges believe the question needs more clarity/details, they can close it without the need for consensus. Now, this creates a problem where those with a different view don't have the said privilege. What if an average question requires 2 minutes to comprehend, but a user with privileges considers any question requiring more than a minute is too much work? What happens, if a user with privileges finds hard to comprehend everything than the average user? This is why those with privileges should act sparingly and not act proactively. This won't be a problem, if there are many others with the same privilege actively participating, as there would be balance.

0

To the question of "Does Web Apps Require Research?"

I'd say - fine to say it requires research but then how are posts dealt with that don't show research, is the issue.. e.g. suppose an answer was posted, but somebody comes along 5 years later and says no research, so close the question(which then can get deleted)! I don't think that's fair. Or next worst thing is question gets voted to close with no comment as to why. Or gets closed but the comment doesn't say no research, but says "not enough detail". The person that posted it should get a clear notification.. so they don't have a situation where their question gets closed and it completely blindsides them.. While they get stupid notifications any time somebody gives them +10 points but they get no notification when their post gets closed or voted to close! So it's about how policies are implemented.

imposing research requirements might discourage users from asking questions.

I think more of an issue is the treatment of posts of users that have much experience on stackexchange generally, including SO, and the closing of their questions, which particularly happens on webapps, even if they have an accepted answer. Closing can precede deletion, cos eventually a mod can sweep through closed questions and delete them. and then content with some good info can get deleted.

If a new user faces comments asking them about their workings. and gets mad, then stackexchange isn't for them. When I was a new user, I was fine with addressing any comments participating in a question I post, and still am.

What level of research needs to be demonstrated for a question to be acceptable?

Can you show cases where this was an issue? (That will make it much easier to answer that question). It is difficult to come up with a blanket general rule of what constitutes enough research, that covers -any- question.

If there is a dispute over whether a question shows enough research, then the questioner can easily comply with the requirements of the commenter that asks them something.

I've rarely seen a request for some research to be something that'd take a week for the questioner to do!

My issue is, how do you treat a question that is thought to not show research. And old question vs new question.

I've had a question that was voted to close for lack of research, i got no notification of it, there was no comment asking me to add any research. I somehow managed to notice an email somewhere, on whatever email address i've got associated with stackexchange, mentioning that my question had been closed or something like that. No comment, nothing in my notifications.

It really shouldn't be allowed to close or vote to close, without a comment. Some might debate whether a downvote requires a comment, but a vote to close is another level. Especially when it's not simply spam. It's a complete lack of regard to not comment. Infact, really, there should be a comment, and some time for them to reply, before voting to close. The fact users that posts quality questions can have many a number of them closed in such a hidden way is terrible.

can you please state your stance? Should research be required? (yes/no. If yes, how much research?)

I wouldn't be keen to say yes or no 'cos it's so unclear what it'd mean.

And it's such a general question like asking "How do you begin a social interaction" .I wouldn't want to be too formulaic 'cos it'd be unnecessarily restrictive.

What matters is the quality of the question.. that it shouldn't be low quality in terms of "research".

An example of a low quality question in terms of research, would be a question where the answer to it is in the first few Google results and it's clear that the person hasn't made any effort. In which case, a comment can point them to that and the question could be closed.

Trying to force people to state their research can sometimes be a formula for making a question bloated and potentially not as good.. Look at this question I asked on stackoverflow. It's popular. Nobody wants to close it. https://stackoverflow.com/questions/9939760/how-do-i-convert-an-integer-to-binary-in-javascript

Somebody could say "no research" (simply because the question doesn't say anything like "I tried XYZ and it didn't work").

Rather like somebody said on this question of mine where it was voted to close Search YouTube favorites?

But if you look at the stackoverflow question I gave as an interesting case study, many that know javascript could look at that and say "ah that's a good question". Sometimes it can be implicit in the question that somebody has done research. The answer isn't obvious.. The "obvious" thing is to say .toString(2) but that that doesn't actually answer the question since that doesn't cover negative numbers. I could have bloated the question a bit but there's a beauty also in a question not being bloated. My comments on my question, addressing things people say, are not the comments of a lazy clueless guy that hasn't researched anything. And the question is very useful to people.

In contrast, if somebody asked a question that anybody familiar with that knowledge domain knows is an obvious easy question that google would answer straight away, then the questioner clearly hasn't done any research. And the question isn't really useful to people. Somebody should comment on it giving the user some direction and the question should be closed.

I think that's a much better approach, than to say questions should or should not require research 'cos being dogmatic one way or the other is very problematic. Better to understand that some questions don't show signs of a lack of research even if they don't explicitly state much in the way of research, like sometimes a person can ask a good question that possibly a lot of thought went into it and doesn't have an easy obvious answer. And some questions are lazy questions with easily googlable answers. And one shouldn't bundle those two types of question into "no research"! And if it is thought that a question lacks research then it should be dealt with in comment at the time. If the person that asked the question doesn't comply, and the question is just poor quality then sure close it. But don't go retroactively vote to close an old question (and without comment), because it doesn't meet some formula. And that's the danger of a simplistic contentious approach. Things are clearer on a case by case basis. And then we see "ah this is the easily googlable type question where they clearly made no effort". I'd still comment there though both to not be presumptuous(dismissing what might actually be a good question), and to guide the questioner.

3
  • 4
    I think mods have been using "needs details" for questions that they think need more research. Therefore this query to find those questions might be helpful. (Of course, some of them might be just too unclear to answer.)
    – Laurel
    Commented Sep 9, 2023 at 22:46
  • I don't use needs details and clarity for needs research.
    – Blindspots Mod
    Commented Sep 10, 2023 at 0:49
  • 4
    As the answer stands now, it looks to be placing emphasis on criticizing stuff not included in the discussion framework set by SpencerG. I'm not asking that you remove content from your post, just that you clarify how this fits the discussion framework and give more emphasis to the parts that fit the discussion framework or if you are suggesting SpencerG / the CM team to change the discussion framework or open another discussion, please be more explicit about this. Commented Sep 10, 2023 at 16:37
-1

What level of research needs to be demonstrated for a question to be acceptable?

Let's start with anything at all. Something like:

  • I couldn't find the answer in <webapps>'s documentation.
  • <webapps>'s tutorial did not cover this.
  • I Googled this question, but no clear answer was returned / but the returned answers contradict each other.

Preferably with some examples or links to what they found.
Basically, a question should at least require the bare minimum of effort.

Furthermore, should it become a requirement for users to show some level of research, like searching the help center of the web application in question before posting it? How best should that be demonstrated, and to what degree, if any, must it be established?

Without showing that bare minimum of effort, you just have a question that shows no research. So yes, if we're going to require research, it has to be included in the question.


Now, why do I think some research should be shown?

First and foremost, it helps provide context about the user's question. It may just include that one detail that narrows down the question, or it may expose a flaw in the user's reasoning, which resulted in the question in the first place.

A question can't really have too much detail, but even if irrelevant information is added, that could be edited out. You can't edit information into the question when the OP hasn't provided said information.

Learning how to figure out a solution to a problem you're running into is a vital skill everyone needs. Requiring users to do some research might just help them figure out the solution by themselves.

In the end, Stack Exchange sites are not meant to be an all-encompassing database of answers to everything ever. If an answer exists in official documentation, it doesn't need to be on SE.

0
-4

About the proposed policy

A few days ago, SpencerG posted an answer sharing their interpretation about what the conclusion of this discussion should be.

As of October 27th, 2023, the proposal below is considered obsolete.


Level of Research Required in Web Apps

Due to the large diversity of Web applications and the uses that a single app might have, it depends on the problem the user faces and their circumstances. I.E., , the Web Apps SE top tag, corresponds to an online spreadsheet app with features that vary according to the type of user account used; Google consumer accounts have access to certain features, while accounts from specific Google Workspace editions might access to additional features. Google Sheets can be extended and integrated with other systems by end-users in diverse settings, personal, school, small business, government, and corporate.

By research, we understand the time spent by the user on solving the problem faced. Someone with no experience with the problem might have to spend more time than someone with experience. Someone with a high performance in using computers, the Internet and problem-solving might quickly identify what they need to research. Still, someone without these attributes might require a lot of research.

Not all research done by the user should be included in the question. The user should carefully choose what to include to communicate the problem and what was tried effectively and in a way that makes the question attractive to make people interested in answering effectively.

Common Asker Pitfalls

Most of the traffic to Web Apps comes through Google. A Web Apps question was likely shown in the search results, and somehow, the user decided to post a question. Some of these users make pitfalls that I have seen occur repeatedly.

Ignore the Ask Question page guidance

Despite what is said in the modal dialog and the Ask Question page guidance, some users post a plea for help rather than a "practical, detailed question" as referred to in the Web Apps tour.

Let's use the most recent question as an example

How to Detach a Video From a YouTube Playlist

I use YouTube playlists to bookmark videos so I can return to them later. For example, I might have a "Science" playlist for science videos. This lets me find the videos easily if I'm discussing a related topic later with someone. However, when I open a video from a playlist, the playlist remains present on the page. I wish the playlist to go away so I could easily copy the link to that particular video, not the entire playlist. Is there a "detach" button or menu option somewhere that would let me easily detach a video?

As you can see, the OP hasn't mentioned any research done.

Use useless phrases to claim research

Some users think that including phrases like "I have search google and find nothing" is enough to show "research effort". That is just chit-chat that is not providing any value. Something that might be helpful will be briefly describing how the user tried to use Google, DuckDuckGo, or any other web search engine, including a few examples of search queries and a few examples of results explaining why they don't meet the OP's needs.

Ignoring the web app onboarding, getting started, resources for beginners, user interface options and user help.

All the Web apps pointed to massive user base like Google, Facebook and X (formerly Twitter) has simple user interfaces. Some of them have onboarding tutorials to show the users how to start using the basic features and learn about the other features. They all have options or links to access the help center and resources for end users. They should not be ignored as they help the user learn the terms used in the web app, like tweet in X, which is essential to research effectively.

There is no sense in repeating what is on the Web app user interfaces, help center and end-user resources.

Using Web apps as a learning-in-public online notebook

Learning in public is an individual approach to using the Internet to share their development process, hoping to get valuable contributions from friends and strangers. In general terms, it implies making public posts of thoughts and improving them as the thought is being enriched by relations with other thoughts and, in some cases, with research notes.

The problem with using this approach to post a new question in Web Apps is that the new question does not include any research. If they aren't updated they might eventually be automatically deleted if they don't get upvotes / answers or if the people with the vote-to-delete privilege think that the post is not worthy of being kept.

Showing have searched the Help Center

It depends on the problem the user faces and the user's expertise. Most questions asking "Is it possible x?" should be reworded to "How to do x" and include what was found in the help center and why it doesn't meet the user's needs. If nothing was found, the user should describe how the research was done, i.e., mention the help center search and a few examples of the search queries used.

Questions about problems related to the expert use of a tool don't require showing that OP has searched the help center if they are experts on the Web app. This is shown by what is being asked and how it is asked. However, the asker should be aware that the question review could be done by moderators who are not experts on the web app. So, it might be wise to include a brief explanation of the question's complexity or how, being an expert, the OP is still stuck. In most cases, describing what was tried is enough to clarify this.

2
  • 5
    I don't agree with this policy (see my answer for an explanation). And even if I did agree, this policy proposal seems complicated and vague. I suggest that you revise this post to be more concise and straightforward, and state a consistent set of research requirements that can work for all questions, rather than having varying criteria depending on the question. Commented Sep 12, 2023 at 7:04
  • @galacticninja Thanks for your comment. I have extended the first statement to explain why I think it's not possible to have a simple research policy that applies to all questions under the current site scope. Commented Sep 12, 2023 at 16:21

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .