web-scraper-sdk

Web Scraper SDK

This library written in Typescript to take snapshots for microsoft share points

Installing

npm i web-scraper-sdk

or

yarn add web-scraper-sdk

Usage

const webScraperSdk = require('web-scaper-sdk');
webScraperSdk.scrape({
    removeJS: true,
    snapshot: true,
    website: 'wiki',
    headless: false
})

Where ScrapeOptions are:

• removeJS: which means remove all <script> tags from share point.

• snapshot: create a new snapshot, if passed false it will look for an already downloaded snapshot in your project dir

• website: that's either of these websites

  1- wiki

  2- blank

  3- communication

  4- modern

• headless: chromium mode to open

• executablePath: chromium .exe path

• configPath: generated config file, if don't provide it, it will ask you to supply your credentials via command line