655
PSA Huggingface is scraping GitHub (europe.pub)
submitted 2 months ago by to c/programmer_humor@programming.dev
126 comments fedilink hide all child comments
 

https://huggingface.co/spaces/HuggingFaceCode/in-the-stack

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 months ago (1 child)

I would say this is a gray area of law. It hasn't been tested yet. There are a few factors in determining "fair use". One of those factors is commercialization, which could nullify fair use. Another is the amount you're using.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 2 months ago*

    Commercial parody is commonplace fair use. If it surpasses the original... oh well.

    The amount being used becomes negligible as the corpus grows. Filtering a billion webpages into one gigabyte means their average contribution is one byte. Play with the numbers all you like, it's gonna come out to less than a paragraph.

    If we went full copyright maximalist, and criminally banned using anything but public-domain / BSD / CC0 works, the commercial impact would not be much different. The technology itself shifts the economics of text, images, video, and code.

  • permalink
  • fedilink
  • source
  • parent