Wikinews:Bots/Archive 5
|
|
|
|
This is an archive of past discussions from Wikinews:Bots. Do not edit the contents of this page. If you wish to start a new discussion or revive an old one, please do so on the current page. |
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
- Closed as unsuccessful. Unfortunately this request has been open for almost two years with little progress. Please feel free to open a fresh request if and when needed. [24Cr][talk] 19:34, 29 August 2021 (UTC)
- Operator: DannyS712 (talk · contribs)
- Bot name: DannyS712 bot (Talk • contribs • bot status log • actions • block log • other log)
- Programming language: Javascript
- Already used on: None for this task
- Task: Update use-counts regularly (weekly, biweekly, monthly / up to discussion)
The below SQL query retrieves, for each template that has a "use count" sub template, the template/module name, the full number of transclusions, the number that would be put in the template (not the exact number, but some number below it to say "over xxx"), and the name of the use count page. I've only some of the results here, but the total query retrieves 61 rows
| SQL | Current result | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
USE enwikinews_p;
SELECT
CONCAT (
CASE
WHEN tl.tl_namespace = 10 THEN 'Template'
WHEN tl.tl_namespace = 828 THEN 'Module'
END,
':',
tl.tl_title
) AS 'Page',
COUNT(*) AS 'Transclusions',
CASE
WHEN COUNT(*) < 1000 AND MOD(COUNT(*), 100) < 60
THEN CONCAT( SUBSTR(COUNT(*), 1, LENGTH(COUNT(*)) - 2), '00' )
WHEN COUNT(*) < 1000
THEN CONCAT( SUBSTR(COUNT(*), 1, LENGTH(COUNT(*)) - 2), '50' )
WHEN COUNT(*) < 10000 AND MOD(COUNT(*), 100) < 60
THEN CONCAT( SUBSTR(COUNT(*), 1, 1), ',', SUBSTR(COUNT(*), 2, 1), '00' )
WHEN COUNT(*) < 10000
THEN CONCAT( SUBSTR(COUNT(*), 1, 1), ',', SUBSTR(COUNT(*), 2, 1), '50' )
WHEN COUNT(*) < 1000000 AND MOD(COUNT(*), 1000) < 600
THEN CONCAT( SUBSTR(COUNT(*), 1, LENGTH(COUNT(*)) - 3), ',000' )
WHEN COUNT(*) < 1000000
THEN CONCAT( SUBSTR(COUNT(*), 1, LENGTH(COUNT(*)) - 3), ',500' )
ELSE
CONCAT( SUBSTR(COUNT(*), 1, 1), '.', SUBSTR(COUNT(*), 2, 1), ' million' )
END AS 'Over',
CONCAT (
CASE
WHEN tl.tl_namespace = 10 THEN 'Template'
WHEN tl.tl_namespace = 828 THEN 'Module'
END,
':',
tl.tl_title,
'/doc/use-count/doc'
) AS 'Counter'
FROM templatelinks tl
WHERE tl.tl_title IN (
SELECT
SUBSTR(pg.page_title, 1, LENGTH(pg.page_title) - 18)
FROM
page pg
WHERE
pg.page_title LIKE '%/doc/use-count/doc'
AND pg.page_id IN (
SELECT cl.cl_from
FROM categorylinks cl
WHERE cl.cl_to = 'Possible-risk/use-count'
)
)
AND tl.tl_namespace IN (10, 828)
GROUP BY CONCAT(tl.tl_title, tl.tl_namespace)
HAVING COUNT(*) > 100
ORDER BY COUNT(*) DESC;
|
|
The bot would, at a set duration, go and update each counter template with the current transclusions, to keep them (relatively) up to date. The bot will only edit pre-existing templates. Let me know if there are any questions. Thanks, --DannyS712 (talk) 21:37, 13 October 2019 (UTC)
Comments
Comment This doesn't seem needed. I of course have long freely admitted I'm unfond of bots. So I'm left with vaguely negative feelings but, atm, not strong enough to actively oppose. --Pi zero (talk) 22:11, 13 October 2019 (UTC)- @DannyS712: Is this still a current request? --Green Giant (talk) 03:32, 7 August 2021 (UTC)
- I mean, if the community would support this, I can still write it, but I have no objections to closing as expired or withdrawn if not --DannyS712 (talk) 03:47, 7 August 2021 (UTC)
- @DannyS712: Thank you for the prompt reply. My main concern was that it’s been open for so long. I know that you are less active here than you used to be. I think it would be unfair to ask you to commit to this unless you actively wanted to do it. Otherwise I’m not opposed to the proposal. --Green Giant (talk) 03:56, 7 August 2021 (UTC)
- Well since I already did the hard part of writing the query, it should be fairly simple to implement if this gets approved and whenever I have time --DannyS712 (talk) 03:59, 7 August 2021 (UTC)
- The normal process of bot approvals requires a test run, analysis of that run, and then approval if deemed to be done correctly. When you are ready, please go ahead and do a test run of 10 edits. Then we can look at it. Please keep the edit rate at no more than two edits per minute. --Green Giant (talk) 04:22, 7 August 2021 (UTC)
- I don't think it is *that* kind of bot which has multiple edits, but then, I am not too entirely convinced we require tables like these, do we?
•–• 04:26, 7 August 2021 (UTC)
- I don't think it is *that* kind of bot which has multiple edits, but then, I am not too entirely convinced we require tables like these, do we?
- The normal process of bot approvals requires a test run, analysis of that run, and then approval if deemed to be done correctly. When you are ready, please go ahead and do a test run of 10 edits. Then we can look at it. Please keep the edit rate at no more than two edits per minute. --Green Giant (talk) 04:22, 7 August 2021 (UTC)
- Well since I already did the hard part of writing the query, it should be fairly simple to implement if this gets approved and whenever I have time --DannyS712 (talk) 03:59, 7 August 2021 (UTC)
- @DannyS712: Thank you for the prompt reply. My main concern was that it’s been open for so long. I know that you are less active here than you used to be. I think it would be unfair to ask you to commit to this unless you actively wanted to do it. Otherwise I’m not opposed to the proposal. --Green Giant (talk) 03:56, 7 August 2021 (UTC)
┌─────────────────────────────────┘
@DannyS712: It’s been a fortnight since the last comment. Please could you update us on any progress? If not, shall we close it for now? [24Cr][talk] 12:51, 21 August 2021 (UTC)
- Sorry, I don't have enwikinews in my global watchlist so I didn't see it. The table above is just for demonstration of the data that the bot gets, it doesn't edit such a table but rather as I explained above "[t]he bot would, at a set duration, go and update each counter template with the current transclusions" so yes, it has multiple edits. An initial run would probably update most of the existing templates because I assume they haven't been updated in a while. --DannyS712 (talk) 03:15, 22 August 2021 (UTC)
- OK, could you do a test run of maybe 10-20 edits so we can see it in operation? Cheers. [24Cr][talk] 16:38, 22 August 2021 (UTC)
Votes
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
- Closed as successful. [24Cr][talk] 07:08, 30 October 2021 (UTC)
- Operator: Cyberpower678 (talk · contribs) and Harej (talk · contribs)
- Bot name: InternetArchiveBot (Talk • contribs • bot status log • actions • block log • other log)
- Programming language: PHP
- Already used on: Operates on dozens of additional Wikimedia wikis
- Task: InternetArchiveBot identifies dead links and adds links to archived versions where available. Per request on Phabricator. Harej (talk) 22:32, 20 January 2021 (UTC)
Comments
Task 1
Comment @Harej: Please note, I would like to have all links (not just the dead links) archived. There are roughly 22k articles in the CAT:Published category. And the bot just needs to archive the links, it should NOT edit the articles. After all the links are archived in that category, IABot needs to monitor the same category for any new additions to the category. Can you please confirm IABot can do that, Harej? Thanks.
•–• 06:31, 21 January 2021 (UTC)- Why should the bot not edit the articles? Providing working alternatives to non-functioning links is the entire point. Harej (talk) 17:17, 21 January 2021 (UTC)
- @Harej: We use {{source}} for adding the sources as well as the external links. That template has parameters to mark if the link is broken or to provide archived link. However, there are articles which do not use that template. We do not remove/replace sources after the article is published. However, while cleaning up, if a source has broken URL, admins generally find the archived version and add it. Giving a bot access to edit and review archived pages is scary -- as it could do irreversible damage. We wish to use the bot to save the source before the link rot -- once it is saved, one could add the archived version. Moreover, if an archive already exists, there is a sapient decision to make which version of the archive to use. There are articles which are not sighted (maybe because the file/template used for that page has been modified) -- if the bot were to add archived links to that article and sights, such important changes would disappear unnoticed forever. That is why the bot should not be directly editing the article, just merely archiving all the hyperlinks.
•–• 17:45, 21 January 2021 (UTC)- InternetArchiveBot operates on 50 Wikimedia wikis without causing "irreversible damage" to them. In the event the bot malfunctions on a given wiki, mistakes can be undone and the bot can be stopped by any logged in user through the bot interface. The bot is very sophisticated, can be configured to parse templates as well as fix plain links, and automatically picks archives closest to when the link was added. The Wayback Machine has been automatically saving outbound links on Wikimedia projects for years. The benefit of proactively, and automatically, fixing broken links vastly outweighs the risks. Linkrot is endemic to wikis at such a scale that automated solutions are required. Harej (talk) 17:59, 21 January 2021 (UTC)
- With respect, acagastya is correct: there is danger of irreversible damage. There's history here, between Wikinews and the Foundation, involving a WON'T FIX closure of a Bugzilla request (from before my time, but I learned about it from bawolff). 'Nuff said on that point, I hope. --Pi zero (talk) 18:18, 21 January 2021 (UTC)
- I don't know what the Wikimedia Foundation has to do with this; InternetArchiveBot is a service of the Internet Archive. The bot is operated in many diverse contexts and can be highly customized for a given use case, and I am more than happy to work with the community on that. If you do not want InternetArchiveBot to fix broken links, which is its primary function, then I am not sure what you are requesting at all. If you want the Wayback Machine to preserve outgoing links, it is already doing that. Harej (talk) 18:22, 21 January 2021 (UTC)
- What you may be interested in is not automated operation, but the option to scan a page and add archives with the element of human review. If so the Analyze a Page feature may be useful for you. (Make sure you have "English Wikinews" as your selected project.) With this you can enter a page title, have it retrieve archive links for all links (not just dead ones), and make the edits conveniently while giving you the ability to review. This may be a more workable option. Harej (talk) 02:11, 22 January 2021 (UTC)
- With respect, acagastya is correct: there is danger of irreversible damage. There's history here, between Wikinews and the Foundation, involving a WON'T FIX closure of a Bugzilla request (from before my time, but I learned about it from bawolff). 'Nuff said on that point, I hope. --Pi zero (talk) 18:18, 21 January 2021 (UTC)
- InternetArchiveBot operates on 50 Wikimedia wikis without causing "irreversible damage" to them. In the event the bot malfunctions on a given wiki, mistakes can be undone and the bot can be stopped by any logged in user through the bot interface. The bot is very sophisticated, can be configured to parse templates as well as fix plain links, and automatically picks archives closest to when the link was added. The Wayback Machine has been automatically saving outbound links on Wikimedia projects for years. The benefit of proactively, and automatically, fixing broken links vastly outweighs the risks. Linkrot is endemic to wikis at such a scale that automated solutions are required. Harej (talk) 17:59, 21 January 2021 (UTC)
- @Harej: We use {{source}} for adding the sources as well as the external links. That template has parameters to mark if the link is broken or to provide archived link. However, there are articles which do not use that template. We do not remove/replace sources after the article is published. However, while cleaning up, if a source has broken URL, admins generally find the archived version and add it. Giving a bot access to edit and review archived pages is scary -- as it could do irreversible damage. We wish to use the bot to save the source before the link rot -- once it is saved, one could add the archived version. Moreover, if an archive already exists, there is a sapient decision to make which version of the archive to use. There are articles which are not sighted (maybe because the file/template used for that page has been modified) -- if the bot were to add archived links to that article and sights, such important changes would disappear unnoticed forever. That is why the bot should not be directly editing the article, just merely archiving all the hyperlinks.
@Harej: I don't think it works the way I expected. Could you please try with US Republicans query Linux Foundation about open-source security? I think it requires <ref></ref> and does not detect URLs.
•–• 05:54, 22 January 2021 (UTC)
- Acagastya I was not able to run the bot on that page as it is locked. Harej (talk) 18:43, 25 January 2021 (UTC)
- Alternatively, @Harej:, (this is a less likely scenario), if there was a list of source URLs to be archived, can the tool take care of those? I could write a script to extract all URLs, if there exists a way to automate the archival of those URLs.
•–• 11:13, 22 January 2021 (UTC) - There are 82k sources in a 6MB file which needs to be archived <https://0x0.st/-iR0.txt> -- is some way I could use this list, run it across the bot/tool, and archive all the links?
•–• 15:33, 22 January 2021 (UTC)- User:Acagastya the API documentation is available at meta:InternetArchiveBot/API. Harej (talk) 20:22, 22 January 2021 (UTC)
- Thanks, @Harej:. Also, there is some context sensitive information I need to discuss, re IABot. Will you be available on IRC?
103.48.105.246 (talk) 20:36, 22 January 2021 (UTC)- Sure, I am in #IABot on Freenode as "harej". Harej (talk) 20:55, 22 January 2021 (UTC)
- Thanks, @Harej:. Also, there is some context sensitive information I need to discuss, re IABot. Will you be available on IRC?
- User:Acagastya the API documentation is available at meta:InternetArchiveBot/API. Harej (talk) 20:22, 22 January 2021 (UTC)
- I'm confused as to what the opposition is to this bot. It has been useful on countless wikis and is not likely to cause any damage. Even if it did, it could be easily reverted. It is useful for dead links. --IWI (talk) 14:01, 25 January 2021 (UTC)
- Actually, as noted above some damage that can be done is irreversible. --Pi zero (talk) 14:50, 25 January 2021 (UTC)
- Can you explain how irreversible damage happens on a wiki when all versions of a page are stored and can be restored at any time? I don't think this was ever clearly explained. Harej (talk) 17:54, 25 January 2021 (UTC)
- It's not readily fixable; as I remarked before, the bugzilla request was closed as WON'T FIX. Given which, I'm not really seeing any cause to dwell on the details (unless you know of someone considering attempting a rewrite of the DPL extension, in which case please let me know and perhaps I'll contact them). --Pi zero (talk) 20:29, 25 January 2021 (UTC)
- Can you explain how irreversible damage happens on a wiki when all versions of a page are stored and can be restored at any time? I don't think this was ever clearly explained. Harej (talk) 17:54, 25 January 2021 (UTC)
- Actually, as noted above some damage that can be done is irreversible. --Pi zero (talk) 14:50, 25 January 2021 (UTC)
We needed IABot to take care of two different tasks. Upon careful discussion, it was agreed to split the tasks, the prior being taking the snapshot of all the sources in archives (currently under progress, oversee by user:acagastya); and the other being taking snapshots of all the sources for new articles. Since the first task is under progress, let's focus the discussion on just the latter task.
•–• 20:34, 25 January 2021 (UTC)
Task 2
Comment @Harej: All the sources used in a mainspace article are expected to be listed in the url parameter of {{source}}. {{source}} also accepts archiveurl parameter. Could you configure IABot in such a way that it archives the sources from mainspace articles (which are NOT archived), from url and update archiveurl? @Pi zero: does this sound safe? I hope I am not overlooking something, please let me know if I am.
•–• 20:41, 25 January 2021 (UTC)
- I have configured the bot to recognize the "archiveurl" parameter. Harej (talk) 20:50, 25 January 2021 (UTC)
Comment Seems to me one ought to wait until publication-plus-24-hours before archiving sources. Other than that, I have no strong objection; the most technical harm that could possibly be done is quite limited. --Pi zero (talk) 21:05, 25 January 2021 (UTC)
Question @Harej: Does IABot have specific triggers (like working at the time of new page creation)? Or does it work in a said time-interval? Re what @Pi zero: has added Harej, I think IABot can just check, if(wikitext.categories.includes('Published')) { run(); }. Will that work? Additionally, can you control which snapshot instance will be added to archive URL? The snapshot with timestamp closest after category:published was added will be ideal.
•–• 07:17, 26 January 2021 (UTC)
- (Yeah, published will likely do, which would admittedly be much easier.) --Pi zero (talk) 17:45, 26 January 2021 (UTC)
- Acagastya, IABot does not have triggers. However, the bot will use the archive corresponding to the stated access time in the citation, or the closest one to when the URL was added. Harej (talk) 17:20, 1 February 2021 (UTC)
- (Yeah, published will likely do, which would admittedly be much easier.) --Pi zero (talk) 17:45, 26 January 2021 (UTC)
Question @Harej: Would IABot be able to fill in all three parameters on {{source}} for pages with deadlinks? Namely also, brokenURL and archivedescription when links are being recovered? —chaetodipus (talk · contribs) 04:46, 29 July 2021 (UTC)
Question @Cyberpower678, Harej: I see the Phabricator note says this is stalled. Could you briefly outline what needs to be done to unstall? --Green Giant (talk) 03:38, 7 August 2021 (UTC)
- @Cyberpower678, Harej: It’s been a fortnight with no response. Please could you provide an update? If not, shall we close this request? [24Cr][talk] 12:54, 21 August 2021 (UTC)
- @Cromium: I think that is because noone here is voting -- we need to vote it to pass or fail for them to proceed.
•–• 12:59, 21 August 2021 (UTC)- @Acagastya: Is that why it is listed as stalled? If so, we can vote but I was hoping to see a test run of 10-20 edits first. However, if the same task is being done on another wiki, I guess we can move to approval. [24Cr][talk] 13:10, 21 August 2021 (UTC)
- I will test the bot for 20 edits. After around 20 edits I will stop the bot, and let you assess. Harej (talk) 22:08, 13 September 2021 (UTC)
- This may be delayed as the bot is currently down for maintenance. Harej (talk) 23:44, 13 September 2021 (UTC)
We have been trying to do test edits on the bot and have not been succeeding. Basically the bot goes through AllPages in alphabetical order and all the pages it has come across are protected. The bot will work for “single page” runs via the Management Interface (makes edits on your user account’s behalf, so it will work on the pages you normally can edit) and also multi-page runs for unprotected pages. If you want the bot to make background edits, it will need to be promoted to admin. Harej (talk) 19:08, 27 September 2021 (UTC)
- @Harej: I’ve promoted the bot to admin for a month to help the test run. Please advise if anything else is needed. [24Cr][talk] 12:53, 2 October 2021 (UTC)
- @Harej, I saw the bot made a single edit so far (diff). If the bot is rescuing a dead link in sources, can it also add "brokenURL = true" so that it displays the archived link in the article? —chaetodipus (talk · contribs) 04:39, 20 October 2021 (UTC)
- chaetodipus, it will add that parameter on future edits. Harej (talk) 18:30, 20 October 2021 (UTC)
- @Harej, I saw the bot made a single edit so far (diff). If the bot is rescuing a dead link in sources, can it also add "brokenURL = true" so that it displays the archived link in the article? —chaetodipus (talk · contribs) 04:39, 20 October 2021 (UTC)
Votes
Support given the limitations of the bot (the way it was designed, to serve a specific purpose), I think it is achieves a part of the task, and I am okay with the compromise.
•–• 17:34, 1 February 2021 (UTC)
- And thinking about it, if the bot does not edit semi-protected pages, we won't royally screw up. :D
•–• 17:36, 1 February 2021 (UTC)
Support if it gets the process moved to implementation. [24Cr][talk] 00:01, 27 August 2021 (UTC)
Support I think this would definitely be useful in recovering the many dead sources in our archives. —chaetodipus (talk · contribs) 05:27, 21 October 2021 (UTC)
Support I am familiar with IAB and find it extremely useful on other projects. I am surprised to learn in viewing this request that it isn't already approved. I think including this is a no-brainer. --TheSandDoctor (talk) 21:29, 22 October 2021 (UTC)
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
Neriah bot (talk · contribs)
Operator: user:Neriah
Bot tasks for which permission is being sought: Treatment of Double Redirects (450+).
Automatic or manually assisted: Automatic.
Edit type: one time.
Maximum edit rate (e.g. edits per minute):
Bot flag requested: (Y/N): I need a bot flag for a week.
Programming language(s): python.
Neriah (talk) 13:42, 21 December 2022 (UTC)
Comments
- Can you briefly describe/explain the problem (with a bit more detail) you are intending to address, please? --Bddpaux (talk) 19:28, 4 January 2023 (UTC)
- Bddpaux, I would like to run a bot that fixes the double redirects (mw:Manual:Pywikibot/redirect.py). The problem with Double Redirects is that when we go to a certain page (like Wikinews Shorts: January 14, 2009) the site jumps to the next referral page, and not to the third page... This bot runs regularly on many sites, and here on the site I saw that it does not. Usually there are not many Double Redirects on the sites, so it is possible to run without a bot account, but here there are several hundred, so in this run I need a bot account, and later on not because it will be individual edits. Neriah (talk) 10:13, 6 January 2023 (UTC)
- @Bddpaux? Neriah (talk) 10:58, 13 January 2023 (UTC)
- Bureaucrats Can you perform? Neriah (talk) 13:29, 20 January 2023 (UTC)
- ? Neriah (talk) 20:27, 30 January 2023 (UTC)
- The 'crats are not active very often. Sorry, SVTCobra 20:46, 30 January 2023 (UTC)
- Yes. Perhaps try messaging Gryllida
or Acagastya? Sorry, I did not realize Acagastya is not one (a CU but not a bureaucrat?). Heavy Water (talk) 20:51, 30 January 2023 (UTC)- I don't think it's appropriate to give it to your main account, as then malfunctions in the bot may lead to your main account being blocked. Could you make a separate account for the bot please? Then I will be able to give it the bot flag. Gryllida (talk) 21:09, 30 January 2023 (UTC)
- User:Neriah bot. Neriah (talk) 21:04, 31 January 2023 (UTC)
- I updated this page to reflect this. SVTCobra 22:16, 31 January 2023 (UTC)
- Ta. Bot flag added. Gryllida (talk) 22:54, 31 January 2023 (UTC)
- (Note that I have set it to expire in a month, just in case there are some unforeseen tasks that might take more than a week, as requested above.) Gryllida (talk) 22:55, 31 January 2023 (UTC)
- As only a week was requested, a month seems fine. Cheers, SVTCobra 23:21, 31 January 2023 (UTC)
Done Neriah bot (talk) 06:02, 1 February 2023 (UTC)
- @Gryllida Since this is at the bot's expense, I think it's worth flagging a bot indefinitely. Do we need a new vote for this or not? Neriah (talk) 09:06, 10 February 2023 (UTC)
- Hi,
- I would like to understand the first part of the sentence, "this is at the bot's expense", better. Could you please rephrase it?
- Do you wish to continue running the bot next month?
- Note that I do not mind flagging the bot indefinitely. The only reason I did not do it was because there was a time limit, one week, in the request.
- Regards, -- Gryllida (talk) 02:20, 14 February 2023 (UTC)
- @Gryllida Since this is at the bot's expense, I think it's worth flagging a bot indefinitely. Do we need a new vote for this or not? Neriah (talk) 09:06, 10 February 2023 (UTC)
- As only a week was requested, a month seems fine. Cheers, SVTCobra 23:21, 31 January 2023 (UTC)
- User:Neriah bot. Neriah (talk) 21:04, 31 January 2023 (UTC)
- I don't think it's appropriate to give it to your main account, as then malfunctions in the bot may lead to your main account being blocked. Could you make a separate account for the bot please? Then I will be able to give it the bot flag. Gryllida (talk) 21:09, 30 January 2023 (UTC)
- ? Neriah (talk) 20:27, 30 January 2023 (UTC)
- Bureaucrats Can you perform? Neriah (talk) 13:29, 20 January 2023 (UTC)
- @Bddpaux? Neriah (talk) 10:58, 13 January 2023 (UTC)
- Bddpaux, I would like to run a bot that fixes the double redirects (mw:Manual:Pywikibot/redirect.py). The problem with Double Redirects is that when we go to a certain page (like Wikinews Shorts: January 14, 2009) the site jumps to the next referral page, and not to the third page... This bot runs regularly on many sites, and here on the site I saw that it does not. Usually there are not many Double Redirects on the sites, so it is possible to run without a bot account, but here there are several hundred, so in this run I need a bot account, and later on not because it will be individual edits. Neriah (talk) 10:13, 6 January 2023 (UTC)
@Gryllida: Can you close this if the bot was approved? Also, please update the active bot list. I don't know anything about the tech aspects of our beloved Wikis. Cheers, --SVTCobra 02:05, 14 February 2023 (UTC)
- I will keep it open for another two days to finalize the discussion of the expiry date on the bot's account, above. I will update the active bot list soon. Gryllida (talk) 02:20, 14 February 2023 (UTC)
- Keep it open? Didn't User:Neriah bot run on February 1 with nearly 500 edits? I am quite certain you granted the bot user rights on January 31. Maybe there's something I don't understand.. Cheers, SVTCobra 02:28, 14 February 2023 (UTC)
- I mean, in the comments above, Neriah asked to extend the bot flag duration from 'one month' to 'indefinite'. If this request is closed, then this section will not be editable, and that discussion will need to stop (and start elsewhere). This would make it fragmented. That's why I am trying to finish that discussion here before closing this request. Gryllida (talk) 03:03, 14 February 2023 (UTC)
- @Gryllida At first I asked for it on my account, but if it's on the bot's account I'd love it to stay forever, so I can run the bot every month. Thanks! Neriah (talk) 10:52, 14 February 2023 (UTC)
- Thank you both. I will adjust the bot flag expiry and close this section within about a day. Gryllida (talk) 11:27, 14 February 2023 (UTC)
- @Gryllida Can you handle and store? Neriah (talk) 15:57, 2 March 2023 (UTC)
- Bot flag expiry set to 'Does not expire'; closing the discussion now. Gryllida (talk) 01:49, 3 March 2023 (UTC)
- @Gryllida Can you handle and store? Neriah (talk) 15:57, 2 March 2023 (UTC)
- Thank you both. I will adjust the bot flag expiry and close this section within about a day. Gryllida (talk) 11:27, 14 February 2023 (UTC)
- @Gryllida At first I asked for it on my account, but if it's on the bot's account I'd love it to stay forever, so I can run the bot every month. Thanks! Neriah (talk) 10:52, 14 February 2023 (UTC)
- I mean, in the comments above, Neriah asked to extend the bot flag duration from 'one month' to 'indefinite'. If this request is closed, then this section will not be editable, and that discussion will need to stop (and start elsewhere). This would make it fragmented. That's why I am trying to finish that discussion here before closing this request. Gryllida (talk) 03:03, 14 February 2023 (UTC)
- Keep it open? Didn't User:Neriah bot run on February 1 with nearly 500 edits? I am quite certain you granted the bot user rights on January 31. Maybe there's something I don't understand.. Cheers, SVTCobra 02:28, 14 February 2023 (UTC)
Votes
Support --SVTCobra 22:37, 22 December 2022 (UTC)
Support I don't know much about running bots, but you seem to be a trusted contributor on the Hebrew Wikipedia and this is a task that needs doing. Heavy Water (talk) 22:54, 22 December 2022 (UTC)
Support The recent run seems to be successful. Double redirect clean up needs to be done and I know several projects (including those in my native language) do that by bots. Estimating by global contributions, I think this is someone we can trust. MathXplore (talk) 08:32, 23 December 2022 (UTC)
- See my comment above.--Bddpaux (talk) 19:29, 4 January 2023 (UTC)
Support Sounds good to me.--Bddpaux (talk) 15:47, 13 January 2023 (UTC)
Support --DRC-B5 (talk) 14:42, 5 February 2023 (UTC)
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
- Closed as Successful - apologies for the delay. The test edits are just what is needed for these files. Please also add the Image_info if missing. As for which categories to skip, please use your best judgement. Meta user-page is fine. [24Cr][talk] 22:52, 22 October 2023 (UTC)
Operator: User:MGA73
Bot tasks for which permission is being sought: See Wikinews:Water_cooler/assistance#Licenses_on_files_etc. for background information.
I plan to change {{printedition}} to {{Image info}} like this: Special:Diff/4734706
Personally I would perhaps skip Category:February 2006 because Category:February 1, 2006 is a category in Category:February 2006. But File:31January2007.pdf is caegorized in both the day category and the month category.
I can do other stuff too related to cleaning up in files. For example add {{Image info}} if no such template is added or remove Category:Files needing attention if the problem have been resolved.
Automatic or manually assisted: Manually Assisted
Edit type: One time run. Perhaps over several days if I do not have time to change everything in one long run.
Maximum edit rate (e.g. edits per minute): 12 edits per minute.
Bot flag requested: (Y/N): Y
Programming language(s): Pywikipedia MGA73 (talk) 15:10, 6 July 2023 (UTC)
Comments
I have bot flag on several wikis. For example Commons and Japanese wikipedia. I have done millions of edits. --MGA73 (talk) 15:10, 6 July 2023 (UTC)
@Bddpaux, Cromium, Gryllida: Hi! Could one of you have a look at this request? Is there anything I should do? --MGA73 (talk) 15:07, 18 August 2023 (UTC)
- MGA73: The bot has only made eight edits here. To satisfy the letter of WN:Bots/Policy's requirement of 10-20 [bot] edits for demonstration purposes (I presume all of those must be local), can you have it make a few more? And what's the minimum edit rate like? The policy requires a maximum of Heavy Water (talk) 17:42, 18 August 2023 (UTC) 12 per minute, which you say is
theyour bot's maximum. I assume, as a global bot operator, you're aware of the practices in the "Best practices" section of the policy. But I don't understand your reasoning for why you would skip Category:February 2006. Could you explain that more, please? BTW, the edit you linked to above as an example of what the bot would do appears to have been to a now-deleted image. Heavy Water (talk) 15:50, 18 August 2023 (UTC)
- Heavy Water Thank you for your answer. I did a few more edits.
- As for the minimum edits it is not easy to say because I monitor the edits as they happen. So it depends on if I'm distracted by something or not. The rule is that there should be a minimum of 5 seconds between each edit. That will result in a maximum of 12 edits per minute. But I'm open for other edit speeds if that is prefered.
- As for skipping Category:February 2006. Yes the file I mentioned was deleted. But it is the same on all the other edits. On Special:Diff/4734707 for example it would be to skip Category:January 2006 because the file is also in Category:January 2006. On Commons there is a rule not put something in both a category and a subcategory of the same category (c:Commons:Categories#Over-categorization). I do not know if a similar rule/practice exist here. I just thought I wanted to ask before I put hundreds of files in categories.
- Since I made this request I nominated 825 files for deletion (Wikinews:Deletion_requests#825_sxw-files). Depeding on that I can/will either skip edits on sxw-files, add a deletion template on those files or make the same edits as on the pdf-files. --MGA73 (talk) 16:53, 18 August 2023 (UTC)
- I meant to say the policy sets a maximum of twelve per minute, and was only curious what your bot's minimum was, but omitted some words. We place an article in all relevant categories, even if it's already in parent categories (so it's easier for readers to find the latest news about a topic, instead of having to sift through subcategories), but I wasn't aware of any local convention for files. Looking at other month categories, like Category:February 2008, I see a lot of Print Edition files placed in those as well as in date categories. Heavy Water (talk) 17:42, 18 August 2023 (UTC)
- Thank you. In that case I will of course add the categories :-) --MGA73 (talk) 16:22, 19 August 2023 (UTC)
- I meant to say the policy sets a maximum of twelve per minute, and was only curious what your bot's minimum was, but omitted some words. We place an article in all relevant categories, even if it's already in parent categories (so it's easier for readers to find the latest news about a topic, instead of having to sift through subcategories), but I wasn't aware of any local convention for files. Looking at other month categories, like Category:February 2008, I see a lot of Print Edition files placed in those as well as in date categories. Heavy Water (talk) 17:42, 18 August 2023 (UTC)
- Original discussion is now in Wikinews:Water_cooler/assistance/archives/2023/August. --MGA73 (talk) 14:24, 6 October 2023 (UTC)
Comment Bureaucrats are not active at the moment so I have asked on m:Steward_requests/Bot_status#Bot_status_requests if a steward can close this request. --MGA73 (talk) 14:59, 16 October 2023 (UTC)
- Gryllida has been fairly responsive in the past, and Cromium returns from time to time. (I note, though, step I of WN:BOTS implies a bot awaiting approval should have a local user page with {{TestBot}}.) Heavy Water (talk) 17:33, 16 October 2023 (UTC)
- I can add if that is needed. But I hope my bot page on meta is acceptable instead. --MGA73 (talk) 13:32, 19 October 2023 (UTC)
- Gryllida has been fairly responsive in the past, and Cromium returns from time to time. (I note, though, step I of WN:BOTS implies a bot awaiting approval should have a local user page with {{TestBot}}.) Heavy Water (talk) 17:33, 16 October 2023 (UTC)
Votes
Support: This needs done, and the operator is trusted and responsive (and patient, after a long wait with no progress on this request). Heavy Water (talk) 17:42, 18 August 2023 (UTC)
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
Non-bureaucrat archival. See requests here, here, as well as at here. Michael.C.Wright (Talk/Reviewer) 01:24, 5 May 2026 (UTC)
Operator: Leaderboard
Bot tasks for which permission is being sought: meta:Global reminder bot
Automatic or manually assisted: Automatic
Edit type: Daily in theory. However, I think the bot will almost never run on this wiki; however, I'm told that it is still good practice to request approval.
Maximum edit rate (e.g. edits per minute): Maybe once per month at most?
Bot flag requested: (Y/N): N
Programming language(s): Python
Leaderboard (talk) 08:19, 23 August 2024 (UTC)
Comments
- @Gryllida: is this something you could take a look at? Leaderboard (talk) 14:15, 28 September 2024 (UTC)
- On a small wiki I am worried this could be unnecessary as users would make token edits just to keep the access. Is there some evidence that notification, for example if done manually somewhere, improved things and re-engaged the contributor in editing regularly? Gryllida (talk) 13:00, 7 October 2024 (UTC)
- Hi @Gryllida Firstly, this only applies to temporary rights (i.e when you assign a right for a certain period) - it's not going to remind anyone whose rights are technically indefinite (i.e, it does not affect WN:PEP). This bot was launched only in August, so hard evidence is difficult to find; however, this bot was inspired by a case where a user with global rights was unable to help their community because they did not realise that their rights had expired. For a wiki like this (like most small wikis), it is expected to almost never post anything - so it will simply run silently. Does this answer your question? Leaderboard (talk) 13:05, 7 October 2024 (UTC)
- Yes thanks. Then maybe it is not needed here as no privileges expire automatically. I welcome someone pointing out a different point of view, I am rather neutral on this. Gryllida (talk) 13:12, 7 October 2024 (UTC)
- Hi @Gryllida Firstly, this only applies to temporary rights (i.e when you assign a right for a certain period) - it's not going to remind anyone whose rights are technically indefinite (i.e, it does not affect WN:PEP). This bot was launched only in August, so hard evidence is difficult to find; however, this bot was inspired by a case where a user with global rights was unable to help their community because they did not realise that their rights had expired. For a wiki like this (like most small wikis), it is expected to almost never post anything - so it will simply run silently. Does this answer your question? Leaderboard (talk) 13:05, 7 October 2024 (UTC)
- On a small wiki I am worried this could be unnecessary as users would make token edits just to keep the access. Is there some evidence that notification, for example if done manually somewhere, improved things and re-engaged the contributor in editing regularly? Gryllida (talk) 13:00, 7 October 2024 (UTC)
- As I see this a bot flag is not needed. The bot will make very few edits. But I think it will be a good idea for Gryllida or someone else to close this request with a comment like "This bot is approved to do the task. No bot flag is needed." --MGA73 (talk) 15:56, 8 December 2024 (UTC)
- @Gryllida, @RockerballAustralia, it looks like this bot request can also be closed and archived.Michael.C.Wright (Talk/Reviewer) 13:56, 6 April 2026 (UTC)
Votes
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
Non-bureaucrat archival. See requests here, here, as well as at here. Michael.C.Wright (Talk/Reviewer) 01:25, 5 May 2026 (UTC)
Bot tasks for which permission is being sought: Export Flow/LQT boards to wikitext
Automatic or manually assisted: Typically runs at first as one automatic/unsupervised run, and then a later set of automatic/supervised runs to clean up cases the original one punted on. Or at least that's how I did it on MediaWiki.org
Edit type: One-time run
Maximum edit rate (e.g. edits per minute):
Bot flag requested: (Y/N): Y
Programming language(s): Python
Code at https://gitlab.wikimedia.org/pppery/flow-export-with-history and https://gitlab.wikimedia.org/pppery/flow-topic-links-fix. I tend to make minor uncommitted changes to the code as I run into issues, some of which don't make it all the way to the repo.
This bot will also need admin permissions, and XML importer permissions (since it imports the Flow boards with revision history to allow comments to show up in users' contributions among other things). Bot and admin can be granted by local crats, XML importer on most wikis can be granted only by stewards. I'm assuming I only need to request bot rights, not file separate permissions for those other groups. * Pppery * it has begun... 16:21, 16 October 2025 (UTC)
Comments
Votes
- Strong
Support - We urgently and definitely need this bot for the final process of moving away from LQT. WMF will probably only assist with converting to Flow, and Pppery has offered to help with converting Flow to wikitext. -- Asked42 (talk) 18:38, 17 October 2025 (UTC)
Support Pinging @Gryllida and @Bddpaux, both of whom I've seen active recently and both are bureaucrats.Michael.C.Wright (Talk/Reviewer) 00:25, 21 October 2025 (UTC)
- on it Gryllida 03:35, 21 October 2025 (UTC)
- hi @Pppery bot flag granted for a month. its duration was unspecified in the request but i assumed thats enough for the task, and then i will not need to come back to take it off, please let me know if you needed some other duration, thank you! Gryllida 03:37, 21 October 2025 (UTC)
- A month is fine in terms of duration (assuming the WMF actually runs their script then - I filed this beforehand because enwikinews is not known for doing things promptly), but I also need admin rights on the bot since my plan is to delete the Flow board to replace it with the wikitext version (and also XML importer because I use the import API to import content with history, but only the stewards can grant that). * Pppery * it has begun... 03:40, 21 October 2025 (UTC)
- Hi @* Pppery *
- 1. What their script. I thought flow can start to be used straight away.
- 2. There are two halves of the task, conversion to wikitext and page deletion. I am thinking that you can do the conversion to wikitext without admin right; and there is possibly a tool to mass delete what needs to be deleted. Is there a namespace for it? It will be everything in 'Thread:' isn't it? I think Special:Nuke can do it (docs: https://www.mediawiki.org/wiki/Help:Extension:Nuke ); if that's what's needed, i can do it for you after the conversion to wikitext is finished. Please let me know if that's a reasonable approach.
- Thanks, --Gryllida 19:00, 21 October 2025 (UTC)
- @Gryllida: WMF will run its script to convert LQT pages to Flow, and this bot will then convert those Flow pages to wikitext. The bot will only suppose to run after WMF completes its conversion. --Asked42 (talk) Asked42 (talk) 19:02, 21 October 2025 (UTC)
- also see Wikinews:Water cooler/proposals#Phase_2:_Converting_LQT_to_Flow. --Asked42 (talk) 19:03, 21 October 2025 (UTC)
- Oh I thought if someone converts LQT to Flow, then there is nothing left to do. I am not well informed. Gryllida 19:17, 21 October 2025 (UTC)
- I guess I could technically do the import to a separate subpage, and not require deleting anything, but I had thought the plan was to do an outright replacement of the LQT with the Flow and then with the wikitext, all leaving as few traces of the previous state as possible behind, which requires deleting both the Flow board and the "/LQT Archive 1" leftovers. I could have built the bot in a different way, I guess, to need fewer permissions, but I didn't expect this to be a problem. And, re Gryllida, Flow is also being deprecated and was only intended to be an intermediate state. * Pppery * it has begun... 19:48, 21 October 2025 (UTC)
- Let me try to elaborate. As I understand the plan:
- For every LQT board (with at least one thread on it), the WMF will run a script to convert that board to Flow. This script will.
- Move the existing page there to its current title + "/LQT Archive 1".
- Create a new Flow board at that title with the same content (and history) as the LQT thread it's replacing.
- Once all of that is done, I plan to run my bot. It will, for every Flow board:
- Delete the "/LQT Archive 1" page (this part requires admin rights)
- Delete the Flow board created in the previous step (this part requires admin rights)
- Reconstruct the history of the board as if the entire discussion had been done in wikitext from the start
- Use (the API version of) special import to import that history to the wiki onto the title that the Flow board (and previously the LQT thread) used to be (this part require XML importer rights).
- Then, once all of that is done, as a second pass it will find all pages linking to "Thread:" pages, and change them to link to the converted wikitext thread (as a minor cleanup matter).
- For every LQT board (with at least one thread on it), the WMF will run a script to convert that board to Flow. This script will.
- I could do only steps 2.3 and 2.4, importing to a different title instead, and thus not need admin (but still need XML importer). I'll do that if you really want, but it seems like it foists additional technical work onto others for no clear reason. * Pppery * it has begun... 21:04, 21 October 2025 (UTC)
- Let me try to elaborate. As I understand the plan:
- @Gryllida: WMF will run its script to convert LQT pages to Flow, and this bot will then convert those Flow pages to wikitext. The bot will only suppose to run after WMF completes its conversion. --Asked42 (talk) Asked42 (talk) 19:02, 21 October 2025 (UTC)
- Thanks, --Gryllida 19:00, 21 October 2025 (UTC)
- Does LQT have an API? It might be easier to do this in one step. Leaderboard (talk) 15:04, 22 October 2025 (UTC)
- It does, and in fact the WMF's script to convert to Flow does use that API. But people have already written LQT->Flow and Flow->Wikitext converters whereas nobody has written a clean LQT->Wikitext converter directly. See also phab:T381906. * Pppery * it has begun... 15:36, 22 October 2025 (UTC)
- Thank you for your time and help with completing the conversion @Pppery. It seems, from the Phab comment that the conversion from LQT to Flow is mostly done. Does that mean you can now perform the final conversion? --Asked42 (talk) 09:06, 11 November 2025 (UTC)
- I'm still waiting for my bot to be granted admin (and XML importer which only the stewards can do) rights? * Pppery * it has begun... 16:08, 11 November 2025 (UTC)
- Pinging @Gryllida. --Asked42 (talk) 16:27, 11 November 2025 (UTC)
- Permission granted. For 1 month. Please ping me if you finished earlier. Gryllida 11:42, 21 November 2025 (UTC)
- Confirming I've seen this. Will run the bot later today or tomorrow most likely. * Pppery * it has begun... 20:23, 21 November 2025 (UTC)
- Permission granted. For 1 month. Please ping me if you finished earlier. Gryllida 11:42, 21 November 2025 (UTC)
- Pinging @Gryllida. --Asked42 (talk) 16:27, 11 November 2025 (UTC)
- I'm still waiting for my bot to be granted admin (and XML importer which only the stewards can do) rights? * Pppery * it has begun... 16:08, 11 November 2025 (UTC)
- Thank you for your time and help with completing the conversion @Pppery. It seems, from the Phab comment that the conversion from LQT to Flow is mostly done. Does that mean you can now perform the final conversion? --Asked42 (talk) 09:06, 11 November 2025 (UTC)
- It does, and in fact the WMF's script to convert to Flow does use that API. But people have already written LQT->Flow and Flow->Wikitext converters whereas nobody has written a clean LQT->Wikitext converter directly. See also phab:T381906. * Pppery * it has begun... 15:36, 22 October 2025 (UTC)
- @Gryllida, @RockerballAustralia, this work has been completed. I believe this request can be closed and archived now.Michael.C.Wright (Talk/Reviewer) 13:52, 6 April 2026 (UTC)
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.
Asked42Bot (talk · contribs)
- The following discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.
Non-bureaucrat archival. See requests here, here, as well as at here. Michael.C.Wright (Talk/Reviewer) 01:26, 5 May 2026 (UTC)
Operator: Asked42 (talk · contribs)
Bot tasks for which permission is being sought: Welcoming newly created temporary accounts that meet specific contribution criteria. The bot checks the previous day's newusers log and posts a welcome template to the user's talk page. It strictly filters for accounts that have at least one valid, non-reverted edit outside the User and User talk namespaces, and ensures the account is neither currently blocked nor already welcomed.
Automatic or manually assisted: Automatic (Unsupervised, running via a scheduled GitHub Actions workflow).
Edit type: Daily
Maximum edit rate (e.g. edits per minute): Less than 5 edits per minute. The bot processes a small daily backlog with a 1.5 second delay between queries, so the actual daily edit volume is very low.
Bot flag requested: (Y/N): Y
Programming language(s): Python (using the pywikibot)
Asked42 (talk) 16:30, 2 March 2026 (UTC)
Comments
- This bot has been requested based on the discussions at Wikinews Welcome and temporary accounts on Water Cooler/technical. --Asked42 (talk) 16:39, 2 March 2026 (UTC)
Votes
Support per discussion.Michael.C.Wright (Talk/Reviewer) 18:17, 2 March 2026 (UTC)
- The above discussion is preserved as an archive. Please do not modify it. Subsequent comments should be made on the appropriate discussion page, such as the current discussion page. No further edits should be made to this discussion.