Just need to nostrify (add social login) to this https://webrecorder.net/archivewebpage/

Reply to this note

Please Login to reply.

Discussion

Interesting! This extension will archive a complete website?

A would say a single page.

It records a session, so a whole website if you click everything

IMO recording the session is better than trying to crawl the whole site since it captures exactly what you interested in and doesn't get confused by the way websites are built nowadays

true

That's like the Playwright snapshots.

Consider using kind 31. We put some thought into the tags, to meet academic citation standards.

{

"kind": 31,

"pubkey": "",

"tags": [

// mandatory tags

["u", ""]

["accessed_on", ""],

["title", ""],</p><p>["author", "<author to display for citation>"],</p><p>// additional, optional tags</p><p>["published_on", "<date-time in ISO 8601 format>"],</p><p>["published_by", "<who published the citation>"],</p><p>["version", "<version or edition of the publication>"],</p><p>["location", "<where was it written or published>"],</p><p>["g", "<geohash of the precise location>"],</p><p>["open_timestamp", "<`e` tag of kind 1040 event>"],</p><p>["summary", "<short explanation of which topics the citation covers>"],</p><p>],</p><p>"content": "<text cited>"</p><p>}</p> </div> </div> <div class="collapsed-indicator" id="ind-ed2095c9c969db00e429ee25f57e1f9ad36f18d1debcd030f19476098bb6497a" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> <div class="note reply-note depth-0" id="note-5fdce57293cbd844bb730903b316d0112c322ec6ded4b16d6e8ec1c1e96dc46f"> <div class="note-header"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> <img src="https://dergigi.com/assets/images/avatars/09.png" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93" class="author-link"> <span class="note-author-name" title="6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> Gigi </span> </a> <a href="/post/5fdce57293cbd844bb730903b316d0112c322ec6ded4b16d6e8ec1c1e96dc46f" class="note-date-link" title="2025-08-13T19:46:03Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 1</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('5fdce57293cbd844bb730903b316d0112c322ec6ded4b16d6e8ec1c1e96dc46f')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-5fdce57293cbd844bb730903b316d0112c322ec6ded4b16d6e8ec1c1e96dc46f"> <div class="note-content"> <p>That's very much right-side-of-the-bell-curve from the looks of it.</p> </div> <div class="nested-replies "> <div class="note reply-note depth-1" id="note-d0c9c757e51315f7bff80930b4ed7f229c840d9b456ee1547f1475ee5498ff54"> <div class="note-header"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> <img src="https://dergigi.com/assets/images/avatars/09.png" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93" class="author-link"> <span class="note-author-name" title="6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> Gigi </span> </a> <a href="/post/d0c9c757e51315f7bff80930b4ed7f229c840d9b456ee1547f1475ee5498ff54" class="note-date-link" title="2025-08-13T19:51:04Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 1</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('d0c9c757e51315f7bff80930b4ed7f229c840d9b456ee1547f1475ee5498ff54')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-d0c9c757e51315f7bff80930b4ed7f229c840d9b456ee1547f1475ee5498ff54"> <div class="note-content"> <p>If we wanna use something existing as the base and add some nostr magic to it I'd probably go with something like ArchiveBox</p><p><a href="https://github.com/ArchiveBox/ArchiveBox" target="_blank" rel="noopener noreferrer" class="note-link">https://github.com/ArchiveBox/ArchiveBox</a></p> </div> <div class="nested-replies "> <div class="note reply-note depth-2" id="note-bc0fd836fdadbca96b21409d50e016e46bb9ae5c72948bc87cb4983a893ae4ce"> <div class="note-header"> <a href="/user/17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"> <img src="https://i.nostr.build/NqX203JolXWepok2.jpg" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4" class="author-link"> <span class="note-author-name" title="17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"> elsat </span> </a> <a href="/post/bc0fd836fdadbca96b21409d50e016e46bb9ae5c72948bc87cb4983a893ae4ce" class="note-date-link" title="2025-08-13T19:52:07Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 1</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('bc0fd836fdadbca96b21409d50e016e46bb9ae5c72948bc87cb4983a893ae4ce')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-bc0fd836fdadbca96b21409d50e016e46bb9ae5c72948bc87cb4983a893ae4ce"> <div class="note-content"> <p>Yuge. Immediate fork, with upstream nostr PR would be πŸ”₯</p> </div> <div class="nested-replies "> <div class="note reply-note depth-3" id="note-4c8eec1d4c928e9aa57b4b654c1b25cdb732ecd14dc0c7c9c35230ac17e4a529"> <div class="note-header"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> <img src="https://dergigi.com/assets/images/avatars/09.png" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93" class="author-link"> <span class="note-author-name" title="6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> Gigi </span> </a> <a href="/post/4c8eec1d4c928e9aa57b4b654c1b25cdb732ecd14dc0c7c9c35230ac17e4a529" class="note-date-link" title="2025-08-13T20:14:32Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 2</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('4c8eec1d4c928e9aa57b4b654c1b25cdb732ecd14dc0c7c9c35230ac17e4a529')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-4c8eec1d4c928e9aa57b4b654c1b25cdb732ecd14dc0c7c9c35230ac17e4a529"> <div class="note-content"> <p>Or better yet: <a href="https://github.com/gildas-lormeau/SingleFile" target="_blank" rel="noopener noreferrer" class="note-link">https://github.com/gildas-lormeau/SingleFile</a> - very simple, and is a browser extension already.</p> </div> <div class="nested-replies "> <div class="note reply-note depth-4" id="note-946743749dbbda84334482061f9aba4eb56f14cec805780c0f876417d304e984"> <div class="note-header"> <a href="/user/17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"> <img src="https://i.nostr.build/NqX203JolXWepok2.jpg" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4" class="author-link"> <span class="note-author-name" title="17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"> elsat </span> </a> <a href="/post/946743749dbbda84334482061f9aba4eb56f14cec805780c0f876417d304e984" class="note-date-link" title="2025-08-13T20:16:49Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 1</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('946743749dbbda84334482061f9aba4eb56f14cec805780c0f876417d304e984')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-946743749dbbda84334482061f9aba4eb56f14cec805780c0f876417d304e984"> <div class="note-content"> <p>nostr:npub180cvv07tjdrrgpa0j7j7tmnyl2yr6yr7l8j4s3evf6u64th6gkwsyjh6w6 nostr:npub1yaul8k059377u9lsu67de7y637w4jtgeuwcmh5n7788l6xnlnrgs3tvjmf can y’all combine with nostr browser extension?</p> </div> <div class="nested-replies limit-depth"> <div class="note reply-note depth-5" id="note-dd274421c0689b3796089d564e26f1fe1d62b3570c536ac1eff7e06f3f02fdbb"> <div class="note-header"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> <img src="https://dergigi.com/assets/images/avatars/09.png" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93" class="author-link"> <span class="note-author-name" title="6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> Gigi </span> </a> <a href="/post/dd274421c0689b3796089d564e26f1fe1d62b3570c536ac1eff7e06f3f02fdbb" class="note-date-link" title="2025-08-13T20:22:51Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 3</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('dd274421c0689b3796089d564e26f1fe1d62b3570c536ac1eff7e06f3f02fdbb')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-dd274421c0689b3796089d564e26f1fe1d62b3570c536ac1eff7e06f3f02fdbb"> <div class="note-content"> <p>Push output HTML file to blossom & create archive event accordingly.</p> </div> <div class="nested-replies limit-depth"> <div class="note reply-note depth-6" id="note-616bba76d00b8006613fe846dfb851ce1535412020b2d5eca572fb6129679ce3"> <div class="note-header"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> <img src="https://dergigi.com/assets/images/avatars/09.png" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93" class="author-link"> <span class="note-author-name" title="6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"> Gigi </span> </a> <a href="/post/616bba76d00b8006613fe846dfb851ce1535412020b2d5eca572fb6129679ce3" class="note-date-link" title="2025-08-13T20:23:52Z"> <span class="note-date">4mo ago</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('616bba76d00b8006613fe846dfb851ce1535412020b2d5eca572fb6129679ce3')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-616bba76d00b8006613fe846dfb851ce1535412020b2d5eca572fb6129679ce3"> <div class="note-content"> <p>SingleFile can even be set up to push things to an arbitrary API. So it should be possible to jerryrig this quite quickly with some spit and some duct tape.</p> </div> <div class="nested-replies limit-depth"> <div class="note reply-note depth-7" id="note-59e6a3035ecd59177db2ca551d4b370632c4fa1cef281a4d04875555b7b311ad"> <div class="note-header"> <a href="/user/8fb9450003a599bb1b34f03fadb9b137f6c0e5a850ba205964bee4732ccce549"> <img src="https://hips.hearstapps.com/hmg-prod/images/alpe-di-siusi-sunrise-with-sassolungo-or-langkofel-royalty-free-image-1623254127.jpg?crop=1xw:1xh;center,top&resize=980:*" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/8fb9450003a599bb1b34f03fadb9b137f6c0e5a850ba205964bee4732ccce549" class="author-link"> <span class="note-author-name" title="8fb9450003a599bb1b34f03fadb9b137f6c0e5a850ba205964bee4732ccce549"> the axiom </span> </a> <a href="/post/59e6a3035ecd59177db2ca551d4b370632c4fa1cef281a4d04875555b7b311ad" class="note-date-link" title="2025-08-13T23:09:24Z"> <span class="note-date">4mo ago</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('59e6a3035ecd59177db2ca551d4b370632c4fa1cef281a4d04875555b7b311ad')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-59e6a3035ecd59177db2ca551d4b370632c4fa1cef281a4d04875555b7b311ad"> <div class="note-content"> <p>duct tape is stupid short sighted, you need a decent standard</p> </div> </div> <div class="collapsed-indicator" id="ind-59e6a3035ecd59177db2ca551d4b370632c4fa1cef281a4d04875555b7b311ad" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-616bba76d00b8006613fe846dfb851ce1535412020b2d5eca572fb6129679ce3" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> <div class="note reply-note depth-6" id="note-4842b20523af6d9d881ec2b8e60ef1c43e907271d0bbe35722f351fd3001069b"> <div class="note-header"> <a href="/user/17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"> <img src="https://i.nostr.build/NqX203JolXWepok2.jpg" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4" class="author-link"> <span class="note-author-name" title="17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"> elsat </span> </a> <a href="/post/4842b20523af6d9d881ec2b8e60ef1c43e907271d0bbe35722f351fd3001069b" class="note-date-link" title="2025-08-13T20:24:42Z"> <span class="note-date">4mo ago</span> <span class="reply-count" aria-label="View replies">πŸ’¬ 1</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('4842b20523af6d9d881ec2b8e60ef1c43e907271d0bbe35722f351fd3001069b')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-4842b20523af6d9d881ec2b8e60ef1c43e907271d0bbe35722f351fd3001069b"> <div class="note-content"> <p>nostr:npub1ye5ptcxfyyxl5vjvdjar2ua3f0hynkjzpx552mu5snj3qmx5pzjscpknpr does blossom have some micro-payment mechanism to allow payment for server costs of hosting a webpage?</p><p>Maybe per file/webpage?</p> </div> <div class="nested-replies limit-depth"> <div class="note reply-note depth-7" id="note-36190d87eda1462df1021a0f9e476af8c6366f0c59534a037b329256537756a4"> <div class="note-header"> <a href="/user/8fb9450003a599bb1b34f03fadb9b137f6c0e5a850ba205964bee4732ccce549"> <img src="https://hips.hearstapps.com/hmg-prod/images/alpe-di-siusi-sunrise-with-sassolungo-or-langkofel-royalty-free-image-1623254127.jpg?crop=1xw:1xh;center,top&resize=980:*" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/8fb9450003a599bb1b34f03fadb9b137f6c0e5a850ba205964bee4732ccce549" class="author-link"> <span class="note-author-name" title="8fb9450003a599bb1b34f03fadb9b137f6c0e5a850ba205964bee4732ccce549"> the axiom </span> </a> <a href="/post/36190d87eda1462df1021a0f9e476af8c6366f0c59534a037b329256537756a4" class="note-date-link" title="2025-08-13T23:11:33Z"> <span class="note-date">4mo ago</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('36190d87eda1462df1021a0f9e476af8c6366f0c59534a037b329256537756a4')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-36190d87eda1462df1021a0f9e476af8c6366f0c59534a037b329256537756a4"> <div class="note-content"> <p>we need this</p><p>nostr:nprofile1qqsw9n8heusyq0el9f99tveg7r0rhcu9tznatuekxt764m78ymqu36cpr3mhxue69uhhyetvv9ujucnfw33k76twwpshy6ewvdhk6tcpzdmhxue69uhhwmm59e6hg7r09ehkuef0qy2hwumn8ghj7un9d3shjtn4w3ux7tn0dejj7ne6u4e</p> </div> </div> <div class="collapsed-indicator" id="ind-36190d87eda1462df1021a0f9e476af8c6366f0c59534a037b329256537756a4" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> <div class="note reply-note depth-7" id="note-5e16011bb385fa000dfa23df5bc0b90061487f53de9289275ccaa5ca79c1f3da"> <div class="note-header"> <a href="/user/266815e0c9210dfa324c6cba3573b14bee49da4209a9456f9484e5106cd408a5"> <img src="https://cdn.hzrd149.com/5ed3fe5df09a74e8c126831eac999364f9eb7624e2b86d521521b8021de20bdc.png" class="note-avatar" alt="Avatar" loading="lazy"> </a> <div class="note-info"> <a href="/user/266815e0c9210dfa324c6cba3573b14bee49da4209a9456f9484e5106cd408a5" class="author-link"> <span class="note-author-name" title="266815e0c9210dfa324c6cba3573b14bee49da4209a9456f9484e5106cd408a5"> hzrd149 </span> </a> <a href="/post/5e16011bb385fa000dfa23df5bc0b90061487f53de9289275ccaa5ca79c1f3da" class="note-date-link" title="2025-08-13T23:40:37Z"> <span class="note-date">4mo ago</span> </a> </div> <button class="collapse-toggle" onclick="toggleNote('5e16011bb385fa000dfa23df5bc0b90061487f53de9289275ccaa5ca79c1f3da')" title="Collapse/Expand">[-]</button> </div> <div class="note-body" id="body-5e16011bb385fa000dfa23df5bc0b90061487f53de9289275ccaa5ca79c1f3da"> <div class="note-content"> <p>It depends on the server. Some servers can require the user to be subscribed. But there is also an option to pay-per-request. I built an example server using it</p><p><a href="https://github.com/hzrd149/morning-glory" target="_blank" rel="noopener noreferrer" class="note-link">https://github.com/hzrd149/morning-glory</a></p> </div> </div> <div class="collapsed-indicator" id="ind-5e16011bb385fa000dfa23df5bc0b90061487f53de9289275ccaa5ca79c1f3da" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-4842b20523af6d9d881ec2b8e60ef1c43e907271d0bbe35722f351fd3001069b" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-dd274421c0689b3796089d564e26f1fe1d62b3570c536ac1eff7e06f3f02fdbb" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-946743749dbbda84334482061f9aba4eb56f14cec805780c0f876417d304e984" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-4c8eec1d4c928e9aa57b4b654c1b25cdb732ecd14dc0c7c9c35230ac17e4a529" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-bc0fd836fdadbca96b21409d50e016e46bb9ae5c72948bc87cb4983a893ae4ce" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-d0c9c757e51315f7bff80930b4ed7f229c840d9b456ee1547f1475ee5498ff54" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <div class="collapsed-indicator" id="ind-5fdce57293cbd844bb730903b316d0112c322ec6ded4b16d6e8ec1c1e96dc46f" style="display: none;"> <span class="collapsed-text">Thread collapsed</span> </div> </div> </div> </div> <script> function toggleNote(noteId) { const body = document.getElementById('body-' + noteId); const indicator = document.getElementById('ind-' + noteId); const toggle = document.querySelector('#note-' + noteId + ' .collapse-toggle'); if (body.style.display === 'none') { body.style.display = 'block'; indicator.style.display = 'none'; toggle.textContent = '[-]'; } else { body.style.display = 'none'; indicator.style.display = 'block'; toggle.textContent = '[+]'; } } </script> </main> </div> <script> (function() { const html = document.documentElement; const themeToggle = document.getElementById('themeToggle'); const sunIcon = document.getElementById('sunIcon'); const moonIcon = document.getElementById('moonIcon'); function setTheme(theme) { html.setAttribute('data-theme', theme); localStorage.setItem('theme', theme); if (theme === 'dark') { sunIcon.style.display = 'block'; moonIcon.style.display = 'none'; } else { sunIcon.style.display = 'none'; moonIcon.style.display = 'block'; } } const savedTheme = localStorage.getItem('theme') || 'light'; setTheme(savedTheme); themeToggle.addEventListener('click', () => { const currentTheme = html.getAttribute('data-theme'); const newTheme = currentTheme === 'light' ? 'dark' : 'light'; setTheme(newTheme); }); })(); </script> </body> </html>