plugin to scrape website & convert HTML to markdown #923

I use the copy as markdown plugin of chrome. I find it very convenient.

Thanks for sharing! Looks like copy-as-markdown uses reMarked.js internally, another option besides node-europa for the putative Boostnote plugin.

Screenshot comparing reMarked.js vs pandoc - reMarked has trouble parsing the code blocks for some reason:

reMarked code blocks fenced with 'true'?

This is funny. I couldn't figure out why the reMarked demo was fencing code blocks with 'true'. I think it's just a mistake in how the reMarker object is configured on the demo page:

// code blocks will be delimited with the string 'true'
var reMarker = new reMarked({gfm_code: true});

// this is what we want
// try it by pasting into the console at reMarked demo site
var reMarker = new reMarked({gfm_code: "```"});
reMarker.render(document.getElementById('html-inp').value)

example reMarked.js output w/ {gfm_code: "```"}:

The basics
----------

To create an executable Node.js script all you need is a Node.js shebang at the top of the script and then some code to execute.

```
#!/usr/bin/env node

console.log('hello world');
```

Assuming you are on a UNIX like system you can do this to make the script executable

```
chmod u+x yourscript
```

Now you can run it and you should see ‘hello world’ printed.

```
./yourscript
hello world
```

Handling arguments
------------------

As you get beyond basic scripts you’ll want to pass arguments into the script. The arguments passed to a script are available as `process.argv`.

If you pass arguments to the simple example above and add `console.log(process.argv)` you’ll see the arguments are available as an array. For example if you run

conclusion

I think reMarked.js - when properly configured - produces better output compared with pandoc, and possibly node-europa.

I just found copycat, and am testing it against copy as markdown (no affiliation). Combined with One Tab, my research aka open tabs aka browsing history are becoming useful articles and lists.

@kazup01 has boosted this issue with $100. Visit this issue on Issuehunt

@stormburpee has started working. Visit this issue on Issuehunt

@stormburpee has submitted output. Visit this issue on Issuehunt

Hey guys, feel free to take a look at the pull request I made for this feature over at #1981 Based of the url you suggested in the original post it works great, and I've been doing some testing with a bunch of other websites that I look at, and even ones that you probably wouldn't expect to work.

In the issue I've attached a few example photos for you to see.

@rokt33r has stopped working. Visit this issue on Issuehunt

@kazup01 cancelled funding, $100, of this issue. Visit this issue on Issuehunt

@boostio funded this issue with $100. Visit this issue on Issuehunt

@edokan has started working. Visit this issue on Issuehunt

a good web clipper: https://github.com/mika-cn/maoxian-web-clipper/

Would a web clipper(like Evernote's browser extension) be a better solution for this?

@zerox-dg has rewarded $90.00 to @awolf81. See it on IssueHunt

• :moneybag: Total deposit: $100.00
• :tada: Repository reward(0%): $0.00
• :wrench: Service fee(10%): $10.00

This feature is now available as of 0.13.0, when creating a new note:

sweet!