malscraper.azurewebsites.net
Open in
urlscan Pro
13.77.83.246
Public Scan
Submitted URL: http://malscraper.azurewebsites.net/
Effective URL: https://malscraper.azurewebsites.net/
Submission: On April 24 via api from US — Scanned from DE
Effective URL: https://malscraper.azurewebsites.net/
Submission: On April 24 via api from US — Scanned from DE
Form analysis
1 forms found in the DOMPOST /scrape
<form action="/scrape" method="post">
<fieldset>
<div class="container">
<div class="row">
<div class="column"><label>Username/Kitsu User ID<input type="text" name="username" autofocus=""></label></div>
<div class="column">
<label>List type <select name="listtype">
<option value="anime">MAL Anime List</option>
<option value="manga">MAL Manga List</option>
<option value="animealt">MAL Anime List (HTML scrape, classic lists only)</option>
<option value="mangaalt">MAL Manga List (HTML scrape, classic lists only)</option>
<option value="kitsuanime">Kitsu Anime List</option>
<option value="kitsumanga">Kitsu Manga List</option>
<option value="anilistanime">AniList Anime List</option>
<option value="anilistmanga">AniList Manga List</option>
<option value="anilistanimealt">AniList Anime List (rounded scores)</option>
<option value="anilistmangaalt">AniList Manga List (rounded scores)</option>
<option value="animeplanetanime">AnimePlanet Anime List (updated 2023/01/08)</option>
<option value="animeplanetmanga">AnimePlanet Manga List (updated 2023/01/08)</option>
</select>
</label>
</div>
<div class="column"><input style="margin-top:2.5rem;" type="submit" value="Submit"></div>
</div>
<div class="row">
<div class="column">
<label>Enable <code>update_on_import</code>
<input type="checkbox" name="update_on_import">
</label>
</div>
</div>
</div>
</fieldset>
</form>
Text Content
MAL ENTERPRISES * List export * Cover generation MYANIMELIST / KITSU / ANILIST / ANIME-PLANET EXPORTER Export in MAL XML format. Once exported, import it here. Official export here. Use it if you can login, instead of this (duh). Username/Kitsu User ID List type MAL Anime List MAL Manga List MAL Anime List (HTML scrape, classic lists only) MAL Manga List (HTML scrape, classic lists only) Kitsu Anime List Kitsu Manga List AniList Anime List AniList Manga List AniList Anime List (rounded scores) AniList Manga List (rounded scores) AnimePlanet Anime List (updated 2023/01/08) AnimePlanet Manga List (updated 2023/01/08) Enable update_on_import MYANIMELIST This only works for publicly accesible lists. It uses the (unofficial) endpoint used by modern lists: https://myanimelist.net/animelist/username/load.json?status=7&offset=0 It may intermittently fail, usually retrying works. The alternative is HTML scraping, but this can only be done on classic-style lists; exportable information is limited to visible columns. It's not recommended to use this. KITSU There's a Kitsu exporter. It uses its API, e.g. https://kitsu.io/api/edge/library-entries?filter[user_id]=1234&filter[kind]=anime&include=user,anime,anime.mappings&fields[anime]=canonicalTitle,episodeCount,slug,mappings&fields[mappings]=externalSite,externalId&fields[user]=name&page[limit]=500 If scraping fails, try using your user ID (0000 in https://kitsu.io/users/0000/library); usernames on Kitsu are not unique. ANILIST There's also another AniList exporter. It uses its GraphQL API. By default, scores are always rounded down. For example, 7.5 becomes 7. Selecting the rounded option causes the scores to be rounded to the nearest integer (half up). This means that 7.5 becomes 8, while 7.4 is 7. As an exception, any scores between 0 and 1 will always may to 1, since a score of 0 is disallowed. Details query ($username: String, $type: MediaType) { MediaListCollection(userName: $username, type: $type) { lists { entries { status score(format: POINT_10_DECIMAL) progress progressVolumes repeat priority notes startedAt { year, month, day } completedAt { year, month, day } media { idMal title { romaji } episodes chapters volumes siteUrl } } } } } ANIMEPLANET There's now a scraper for AnimePlanet. A single AnimePlanet entry may map to multiple MAL entries. If this occurs, there will be a comment in the XML. If no mapping can be found, this will also be commented in the XML. Entries in the "Won't Watch" category are still written out in the XML, but they are commented out, since MAL does not have such a similar category. If an entry does not match (see the XML comments), but you know it should match a particular MAL entry, add a comment below. Same too for if an AnimePlanet entry maps to the wrong MAL entry. Details Unlike all the other scrapers, this depends on an offline scrape of both MAL and AnimePlanet that maps the entries between them. Entries were mapped by comparing entry titles (or synonyms), as well as entry episode counts and start years. This includes progressively matching from the most exact matches to less certain matches based on fuzzy text matching. Because of this, there may be errors in how entries are mapped - use at your own risk. This mapping is current as of 2022/01/01, but because it is static, it will fail to map newly added entries. If anyone is particularly keen on maintaining this, reach out. When scraping the list, it scrapes the publicly visible grid view, 560 entries at a time: https://animeplanet.com/users/user/anime?sort=title&mylist_view=grid&per_page=560 AnimePlanet avoids exposing the database id wherever it possibly can, but the database id does in fact exist, and it so happens that the grid view exposes it. This is crucial, because without this, it becomes infinitely harder to perform the mapping. Counterintuitively, the list view doesn't expose that id. Coincidentally, the 'export' that AnimePlanet offers is also garbage, because it doesn't include the database id. There is also an assumption that that database id is unique to the entry, and that ids aren't reused. Somewhat suspicious given the relatively low maximum database id, so if this assumption is false, the mapping will be broken. There are mappings for >90% of the current entries, with most of that remainder being music video entries that MAL does not have. There are also a couple of 100 shows that were difficult to match without some serious digging. There are now mappings for manga, but this is strictly a best-effort match only. There are roughly 3-4x the number of manga to anime, but with much poorer data quality. AnimePlanet disambiguates e.g. Light Novels from Manga in the title as free-form text, making inferring the type difficult. On the other hand, MAL's database is less complete (~40k ~ vs ~60k), with volumes/chapters often not being set. OTHER NOTES For both Kitsu and AniList, check the XML for comments - it will list any entries that have no equivalent MAL entry. If you set the update_on_import checkbox, all entries will have <update_on_import>1</update_on_import> instead of <update_on_import>0</update_on_import> . This will cause all entries to be overwritten by default. COVER IMAGES CSS GENERATION There's a basic css generator for cover images that uses the endpoint mentioned above. See here for more information. -------------------------------------------------------------------------------- 109 KOMMENTARE Kommentar hier eingeben (mindestens 3 Zeichen) Subscribe to email notification of replies Anonym•vor 5 Jahren Fantastic work, seriously. 9 | Antworten Anonym•vor 5 Jahren thank you so much for making the cover image generator!! 2 | Antworten Anonym•vor 5 Jahren Thank you!!! 0 | Antworten Anonym•vor 5 Jahren I'm surprised this works since my Anilist list is "private". Oh well. 0 | Antworten Anonym•vor 4 Jahren Kitsu export is not working for me 1 | Antworten Anonym•vor 4 Jahren Go to your profile and check the URL, you'll see something like https://kitsu.io/users/123456 Use that number in the form above 0 | Antworten Anonym•vor 4 Jahren I would very much like it to have an option to round the notes with .5 from the anilist up to import into my MAL account. Example: 7.5 becomes 8, not 7. 1 | Antworten Anonym•vor 4 Jahren Try now, (it's a new option from the dropdown, you might need to hit refresh) 0 | Antworten Anonym•vor 4 Jahren This is amazing though I hope that someone have one for Anime Planet 0 | Antworten Anonym•vor 4 Jahren bless you 0 | Antworten Anonym•vor 4 Jahren Scrape failed for Kitsu Anime list, tried username and ID. Works fine for manga. 0 | Antworten Anonym•vor 4 Jahren Kitsu issues, try again 0 | Antworten Anonym•vor 4 Jahren Thank you for making this publicly available!! 0 | Antworten Anonym•vor 4 Jahren Scrape failed for Anime Planet? 0 | Antworten Anonym•vor 4 Jahren Fixed, try now 0 | Antworten Okiura•vor 4 Jahren Is there a way to export MAL Comments also ? There is a line for them is the XML files but these are empty. 0 | Antworten Anonym•vor 4 Jahren The comments aren't publicly available, so unfortunately no. -1 | Antworten Anonym•vor 4 Jahren Kitsu anime list export not working 0 | Antworten Anonym•vor 4 Jahren It's a bug in Kitsu's api, not much I can do. 0 | Antworten Anonym•vor 4 Jahren Thank you so much for making this!!! 0 | Antworten Anonym•vor 4 Jahren Thank you very much! 0 | Antworten Anonym•vor 4 Jahren Nice work. Just of curiousity, why there is no contact informarion (site/github/etc), at least i couldnt find one. 0 | Antworten Kineta•vor 3 Jahren Hello! Could you please get in contact with me via PM on MAL? 0 | Antworten DarkMiR4GE•vor 3 Jahren I am writing a code and this link you provided was really helpful. https://myanimelist.net/animelist/username/load.json?status=7&offset=0 However it only gives the first 300 animes in a users list. Can you help me tackle this issue? Already written a huge code really don't want to waste it. Edit: I found a way around. Editing the last part of the url to offset=300 will give the next 300 animes on the list. I can do this iteratively till lists finished up. Still if you can suggest a better way, please do. And thanks a lot. I was neck deep in desperation with this issue 0 | Antworten Anonym•vor 3 Jahren try offset=600 0 | Antworten Anonym•vor 3 Jahren Please add an option to automatically make backups of MAL anime list XML file and send them to an email address every day/week 0 | Antworten Anonym•vor 3 Jahren Isn't working for MAL,scrape failed every time 0 | Antworten AuraStormLucario•vor 3 Jahren MalScraper isn't working :( 0 | Antworten Anonym•vor 3 Jahren How to Export anime list automatically (HTML/JS) https://myanimelist.net/forum/?topicid=1841401 https://myanimelist.net/forum/?topicid=1841098&show=0#post5 0 | Antworten Anonym•vor 3 Jahren Don't do this, you have a working export, use it. 1 | Antworten Anonym•vor 3 Jahren This is automatic bro,way better than needing to write my username every single time! 0 | Antworten Anonym•vor 3 Jahren why is MAL anime export not working ? 0 | Antworten Anonym•vor 3 Jahren why is MAL anime export not working ? 0 | Antworten Anonym•vor 3 Jahren https://myanimelist.net/forum/?topicid=1841882 0 | Antworten Anonym•vor 3 Jahren Thank you,it's working now 0 | Antworten Your biggest fan•vor 3 Jahren OMG This is the best, I've been trying to export AniList for about an year now. Thank you sooo muchh!!! 0 | Antworten Anonym•vor 3 Jahren Is there any way to get the anilist xml to include the entries that mal doesn't have? its for backup purposes 0 | Antworten Anonym•vor 3 Jahren Hey, thanks for this tool. I'm getting HTTP 500 and "Scrape failed" for both MyAnimeList and AniList anime lists 0 | Antworten Anonym•vor 3 Jahren Your list has to be public or it won't work 0 | Antworten Nicole•vor 3 Jahren Your work here is amazing, I can't even start thank you for this. 0 | Antworten Anonym•vor 3 Jahren Awesome!!! I forgot my username and password to MAL and was able to recover everything from this 0 | Antworten Anonym•vor 3 Jahren Hi, I am working on a program to convert AnimePlanet Exports to MAL Exports, would it be possible for you to publish your anime mapping? Thanks 0 | Antworten Anonym•vor 3 Jahren Thank you :) 0 | Antworten Anonym•vor 3 Jahren There are so many animes in my AnimePlanet list that didn't match any entries on MAL when I know they should've, here's the error it gave me. 0 | Antworten Anonym•vor 3 Jahren Wow 0 | Antworten Anonym•vor 3 Jahren MyAnimeList's original export doesn't work, but yours does! Thank you soooo much!!! 0 | Antworten sushi•vor 3 Jahren will this work on ios? 0 | Antworten Jace•vor 3 Jahren I would like to request a feature in Anilist export. If possible, when the entry is non-existent in MAL: Include the 'status', 'started/completed date', 'score'... in the comments. 0 | Antworten Anonym•vor 3 Jahren Done. 0 | Antworten Jace•vor 3 Jahren Thanks! 0 | Antworten Anonym•vor 3 Jahren Yo! I think that to export from Anilist to MAL, the notes could be in the tags in MAL instead of the comments tab (which is kind of useless) 0 | Antworten BatGohan•vor 3 Jahren Scrap failed for anime-planet 0 | Antworten AuraStormLucario•vor 3 Jahren Malscraper's been down for 36 hours now, any updates on what's going on? 0 | Antworten Andi•vor 3 Jahren Same here 0 | Antworten Anonym•vor 3 Jahren Can I donate to you for this tool? 0 | Antworten Anonym•vor 3 Jahren The latest Chrome update is keeping the cover generator from working. :/ It still works in Firefox 0 | Antworten Anonym•vor 3 Jahren Will character exports ever be possible? 1 | Antworten RohanJaeger•vor 3 Jahren Is there no way to import Manga List from Animeplanet? 3 | Antworten Anonym•vor 2 Jahren very useful :p 1 | Antworten JustAwesome•vor 2 Jahren You're awesome, seriously 0 | Antworten thorf•vor 2 Jahren Legend 0 | Antworten Anonym•vor 2 Jahren Thank you for this very simple import/exporter. You guys are awesome! 0 | Antworten Anonym•vor 2 Jahren thank you so much i could kiss and worship the ground before you! 0 | Antworten Anonym•vor 2 Jahren I LOVE YOU IVE BEEN TRYING TO TRANSFER FROM AP TO MAL FOR SO LONG AND I FOUND THIS FINALLY TYSM 0 | Antworten Anonym•vor 2 Jahren Damn, it's sucks that I can't export my manga on Anime Planet 1 | Antworten Anonym•vor 2 Jahren works like a charm 0 | Antworten Anonym•vor 2 Jahren AniList exporter does not work for me 0 | Antworten Anonym•vor 2 Jahren nevermind it works now 0 | Antworten Anonym•vor 2 Jahren Is the Anime-planet manga still in progress? It's working, but it only let me export 124 manga when I have 360 manga on my list. 0 | Antworten Anonym•vor 2 Jahren It's as good as it's going to be without investing significantly more effort. How many of those 236 excluded manga can you actually find on MAL? 0 | Antworten Satoneh•vor 2 Jahren good shit 0 | Antworten Anonym•vor 2 Jahren Hey! I want to import manga list from Anime planet to my Anilist.... I cant figure out how to do that could anyone pls help? Like firstly, what option should i choose? Secondly, if i want to import from Anime planet, do i have to give my anime planet username? Thirdly, once i get the file downloaded, where should i attach that to get anime planet manga on anilist and lastly, will my previous ratings and lists already existing on Anilist be overwritten? 0 | Antworten Kelsey•letztes Jahr Export on here, then select import and choose the xml file 0 | Antworten Anonym•letztes Jahr is it possible to add an option to just transfer Anime-planet to anime-planet, without checking MAL for entries (to prevent missing animes). Good work btw 0 | Antworten Anonym•letztes Jahr hmm, looks like animeplanet only exported 50 of 500 2 | Antworten Anonym•letztes Jahr Loved this for a long time, but the AnimePlanet scrape is now broken, only exporting about a quarter of your list. 1 | Antworten Andre2160•letztes Jahr Animeplanet worked :-) Thanks man :-) 0 | Antworten Anonym•letztes Jahr Thanks for your hard work this is great. Unfortunately, it looks like anime planet is not getting all the titles. 2 | Antworten Anonym•letztes Jahr Hi! I lost access to my account and would like to export my list (friends only) Is there no way for me to export it? I have added myself to another account 0 | Antworten Anonym•letztes Jahr This worked for me!!! Thanks so much! Finally got my Kitsu Anime lists(500+ titles) moved to MAL!! Been putting it off for years not wanting to input it manually. Unfortunately the Manga "scrape" for Kitsu says it failed. At least that list is only not even 1/3 of the Anime one. Thanks again! 0 | Antworten Anonym•letztes Jahr Kitsu export doesn't work despite using User ID 0 | Antworten Anonym•letztes Jahr Thank u very much, it helped (AnimePlanet) 0 | Antworten Anonym•letztes Jahr Will there be an option to import proxer.me or anisearch lists ? 1 | Antworten Anonym•vor 8 Monaten I am also looking for a way to export from Proxer.Me. In case it is helpful, this tool (https://github.com/sotasan/ProxerExport) can generate a JSON file of all Anime/Manga of your account, but it's not enough to translate it into XML. 0 | Antworten Anonym•vor 8 Monaten Also, check out https://github.com/Glup3/proxer-to-anilist 0 | Antworten Anonym•letztes Jahr Awesome utility! Would it be possible to translate scores in different systems manually (e.g. configuring the AniList 5-star system to treat 3 stars as 6/10 on MAL)? 0 | Antworten WaifuSandwich•letztes Jahr Doing the lord's work, you have my blessings. You didn't need to do this but you did. Thanks. Helped me migrate accounts. Luv u. 0 | Antworten Anonym•letztes Jahr Thank you so much for making this. Specially for anilist, they don't offer any export function, so your website is the only way to export. Please keep developing it. 0 | Antworten Anonym•letztes Jahr Thank you! 0 | Antworten Anonym•vor 11 Monaten Thank you for your work 0 | Antworten h04x•vor 10 Monaten Great Service, thank you!! 0 | Antworten Ree•vor 10 Monaten Works great 0 | Antworten based_enjoyer•vor 8 Monaten This is what I love simple and great software! 0 | Antworten Anonym•vor 8 Monaten Doesn't work anymore, sad 0 | Antworten Anonym•vor 7 Monaten Is there an option for ANN? 0 | Antworten Simon•vor 7 Monaten THANK YOU!!!! 0 | Antworten Anonym•vor 7 Monaten Thank you! I'm so glad that this was working exactly as expected even years later. 0 | Antworten Gatsou•vor 6 Monaten Having issues with Anime Planet scrape failed and i have no idea why. Is there a special format i have to follow for username or do i just put in my username ? 0 | Antworten Anonym•vor 6 Monaten Same here. I'm guessing the script is outdated and we'll just have to wait until it's updated. 0 | Antworten Anonym•vor 5 Monaten Is MAL Anime list export working now? I can't restore my account. Via this site I got back my manga list, but can't get anime list. 0 | Antworten Anonym•vor 5 Monaten UP: I have the page with this message "The page cannot be displayed because an internal server error has occurred." 0 | Antworten Anonym•vor 2 Monaten Will it work with anime plant too 0 | Antworten Alan•letzten Monat Great Work 0 | Antworten Anonym•letzten Monat All XML's MAL gave me were malformed. Only figured that out the moment I needed the list. Thankfully this site worked. thank you for that. I'd have lost my list otherwise. 0 | Antworten Anonym•letzten Monat Worked like a charm for Anilist. Thank you! 0 | Antworten soap•letzten Monat MAL entry not found for "blablabla" https:// anilist. co/ manga/blabla123 . Seems like it can't export Anilist's entry if the entry isn't on MAL..........sigh. No wonder why a lot of entries were missing. Will it be fixed someday? 0 | Antworten soap•letzten Monat fyi i tried to move AniList list to another AniList acc 0 | Antworten Anonym•letzten Monat I am facing some issues with anilist.co this export website does not fully export every entry. I exported my anilist XML file into another anilist account for testing if there are any issues regarding the import of all the entries and I found out most of the entries are left out. I tried solving it by unhiding my entries cause I had some of them in my list but it didn't solve the problem then I tried exporting the list from this website again with an update on import but it still didn't solve the problem. Can someone assist, please? I want to make a backup for my list but it won't help if there are problems like these with the export file. I suspect that the problem is the website may have a limited number of entries that can be exported if this is true then I recommend removing the limit of entries. here is my anilist profile link: https://anilist.co/user/GyaruMommy/ -10 | Antworten ru•vor 2 Wochen I tried exporting manga from kitsu and importing to anilist but not my full library was ported. If you take a look at the code from the file you can see in a comment the frase [MAL entry not found for "name"]. I think that's because the names from the two don't match perfectly (if I am wrong please tell me). This may not be a big problem for manga where the names are almost always the same (i think, i don't read that much manga), but it is for manhwa/manhua/webtoons where there are many names for the same serie, and every site chooses which they prefer to use as the main title, and put the rest in the "alternatives titles". For example (looking at the url) the manhwa by the name "I grow stronger by eating" [https://kitsu.io/manga/i-grow-stronger-by-eating] on kitsu has the name "I get stronger the more I eat" [https://myanimelist.net/manga/147592/I_Get_Stronger_the_More_I_Eat]. This can be resolved easily (perhaps not idk) by also comparing the alternative titles when the main don't match (in the example case both have the "I Grow Stronger By Eating" title in the "alternatives titles" section). Maybe the problem is not this tho so if someone knows how to fix this please help me -11 | Antworten