Skip to content

an example would be great! #16

Description

@seiyria

I'm trying to read the README and figure out based on my subroutines, evaluator, surgeon import, and html data how to mesh it all together.

it's tough to know how to go from the yaml config to something that actually works. for example, here is what I have so far:

import { ScraperOperation } from './_base';
import * as request from 'request';
import * as surgeon from 'surgeon';

const URL = 'http://mysite.com';

export class Scraper extends ScraperOperation {
  public scrape() {
    this.readYaml(`test.yaml`) //read as string
      .then(mainSiteInstructions => {
        console.log(mainSiteInstructions);
        request(URL, (err, res, body) => {
          if(err || res.statusCode !== 200) return;

          const x = surgeon.default({ evaluator: surgeon.cheerioEvaluator() });
          x(mainSiteInstructions, body);

        });
      });
  }
}

where the yaml file is:

alphabetLinks:
  - select a {0, } | rp title | test /Rule Index/

I just seem to continuously get errors though.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions