Update CHANGELOG.md

fix: 次バージョンに向けての記載を追加 (#25 )
fix: サマリ取得の動作改善＋動作設定を可能にする (#23 )
2025-08-07 08:43:56 +09:00 · 2024-03-18 19:40:04 +09:00 · 2024-03-18 10:51:35 +09:00 · 2024-03-17 16:53:32 +09:00 · 2023-12-30 16:28:45 +00:00 · 2023-12-30 10:26:31 +00:00
61 changed files with 6028 additions and 11004 deletions
--- a/.editorconfig
+++ b/.editorconfig
@ -5,6 +5,11 @@ indent_style = tab
 indent_size = 2
 charset = utf-8
 insert_final_newline = true
+end_of_line = lf
+trim_trailing_whitespace = true

-[*.json]
+[*.md]
+trim_trailing_whitespace = false
+
+[*.{yml,yaml}]
 indent_style = space
--- a/.eslintrc.cjs
+++ b/.eslintrc.cjs
@ -0,0 +1,16 @@
+module.exports = {
+	root: true,
+	parser: '@typescript-eslint/parser',
+	parserOptions: {
+		tsconfigRootDir: __dirname,
+		project: ['./tsconfig.json', './test/tsconfig.json'],
+	},
+	ignorePatterns: ['**/.eslintrc.cjs'],
+	extends: [
+		'plugin:@misskey-dev/recommended',
+	],
+	rules: {
+		'@typescript-eslint/prefer-nullish-coalescing': 'off',
+		'import/no-default-export': 'off',
+	},
+};
--- a/.github/workflows/lint.yml
+++ b/.github/workflows/lint.yml
@ -0,0 +1,31 @@
+name: Lint
+
+on: [push, pull_request]
+
+jobs:
+  lint:
+    runs-on: ubuntu-latest
+
+    strategy:
+      matrix:
+        node-version: [20.10.0]
+
+    steps:
+      - uses: actions/checkout@v4
+      - name: Install pnpm
+        uses: pnpm/action-setup@v2
+        with:
+          version: 8
+          run_install: false
+      - name: Use Node.js ${{ matrix.node-version }}
+        uses: actions/setup-node@v4
+        with:
+          node-version: ${{ matrix.node-version }}
+          cache: 'pnpm'
+      - name: Install
+        run: |
+          corepack enable
+          pnpm i --frozen-lockfile
+      - name: eslint
+        run: |
+          pnpm eslint
--- a/.github/workflows/npm-publish.yml
+++ b/.github/workflows/npm-publish.yml
@ -0,0 +1,42 @@
+name: Publish Node.js Package
+
+on:
+  release:
+    types: [created]
+
+  workflow_dispatch:
+
+jobs:
+  publish:
+    runs-on: ubuntu-latest
+
+    permissions:
+      contents: read
+      id-token: write
+
+    strategy:
+      matrix:
+        node-version: [20.10.0]
+
+    steps:
+      - uses: actions/checkout@v4
+      - name: Install pnpm
+        uses: pnpm/action-setup@v2
+        with:
+          version: 8
+          run_install: false
+      - name: Use Node.js ${{ matrix.node-version }}
+        uses: actions/setup-node@v4
+        with:
+          node-version: ${{ matrix.node-version }}
+          cache: 'pnpm'
+          registry-url: 'https://registry.npmjs.org'
+      - name: Publish package
+        run: |
+          corepack enable
+          pnpm i --frozen-lockfile
+          pnpm build
+          pnpm publish --access public --no-git-checks --provenance
+        env:
+          NODE_AUTH_TOKEN: ${{ secrets.NODE_AUTH_TOKEN }}
+          NPM_TOKEN: ${{ secrets.NODE_AUTH_TOKEN }}
--- a/.github/workflows/test.yml
+++ b/.github/workflows/test.yml
@ -0,0 +1,34 @@
+name: Test
+
+on: [push, pull_request]
+
+jobs:
+  test:
+    runs-on: ubuntu-latest
+
+    strategy:
+      matrix:
+        node-version: [20.10.0]
+
+    steps:
+      - uses: actions/checkout@v4
+      - name: Install pnpm
+        uses: pnpm/action-setup@v2
+        with:
+          version: 8
+          run_install: false
+      - name: Use Node.js ${{ matrix.node-version }}
+        uses: actions/setup-node@v4
+        with:
+          node-version: ${{ matrix.node-version }}
+          cache: 'pnpm'
+      - name: Install
+        run: |
+          corepack enable
+          pnpm i --frozen-lockfile
+      - name: Build
+        run: |
+          pnpm build
+      - name: Test
+        run: |
+          pnpm test
--- a/.npmignore
+++ b/.npmignore
@ -5,5 +5,5 @@
 npm-debug.log
 gulpfile.js
 tsconfig.json
-tslint.json
+.eslintrc.cjs
 .editorconfig
--- a/.travis.yml
+++ b/.travis.yml
@ -1,14 +0,0 @@
-# travis file
-# https://docs.travis-ci.com/user/customizing-the-build
-
-language: node_js
-
-node_js:
-  - 7.5.0
-
-before_script:
-  - npm run build
-
-cache:
-  directories:
-    - node_modules
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@ -1,4 +1,61 @@
-3.0.0 / 2023-02-12
+5.1.0 / 2024-03-18
+* GETリクエストよりも前にHEADリクエストを送信し、その結果を使用して検証するように (#22)
+* 下記のパラメータを`summaly`メソッドのオプションに追加
+  - userAgent
+  - responseTimeout
+  - operationTimeout
+  - contentLengthLimit
+  - contentLengthRequired
+
+5.0.3 / 2023-12-30
+------------------
+* Fix .github/workflows/npm-publish.yml
+
+5.0.2 / 2023-12-30
+------------------
+* Fix .github/workflows/npm-publish.yml
+
+5.0.1 / 2023-12-30
+------------------
+* Fix .github/workflows/npm-publish.yml
+
+5.0.0 / 2023-12-30
+------------------
+* support `<link rel="alternate" type="application/activitypub+json" href="{href}">` https://github.com/misskey-dev/summaly/pull/10, https://github.com/misskey-dev/summaly/pull/11
+  * 結果の`activityPub`プロパティでherfの内容を取得できます
+* branch.ioを用いたディープリンク（spotify.link）などでパースに失敗する問題を修正 https://github.com/misskey-dev/summaly/pull/13
+* Twitter Cardが読めていない問題を修正 https://github.com/misskey-dev/summaly/pull/15
+* 'mixi:content-rating'をsensitive判定で見ることで、dlsiteなどでセンシティブ情報を得れるように https://github.com/misskey-dev/summaly/pull/16
+* sitenameをURLから生成する場合、ポートを含むように (URL.hostname → URL.host)
+* `Summary`型に`url`プロパティを追加した`SummalyResult`型をexportするように
+* `IPlugin`インターフェースを`SummalyPlugin`に改称
+
+4.0.2 / 2023-04-20
+------------------
+* YouTubeをフルスクリーンにできない問題を修正
+
+4.0.1 / 2023-03-16
+------------------
+* oEmbedの読み込みでエラーが発生した際は、エラーにせずplayerの中身をnullにするように
+
+4.0.0 / 2023-03-14
+------------------
+* oEmbed type=richの制限的なサポート
+* プラグインの引数がWHATWG URLになりました
+
+3.0.4 / 2023-02-12
+------------------
+* 不要な依存関係を除去
+
+3.0.3 / 2023-02-12
+------------------
+* agentが指定されている（もしくはagentが空のオブジェクトの）場合はプライベートIPのリクエストを許可
+
+3.0.2 / 2023-02-12
+------------------
+* Fastifyのルーティングを'/url'から'/'に
+
+3.0.1 / 2023-02-12
 ------------------
 * ES Moduleになりました
  - `import { summaly } from 'summaly';`で関数をインポートします
--- a/2
+++ b/2
@ -1,6 +1,6 @@
 The MIT License (MIT)

-Copyright (c) 2016-2019 syuilo
+Copyright (c) 2016-2024 syuilo

 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal
--- a/README.md
+++ b/README.md
@ -1,6 +1,7 @@
 summaly
 ================================================================

+[![][npm-badge]][npm-link]
 [![][mit-badge]][mit]
 [![][himawari-badge]][himasaku]
 [![][sakurako-badge]][himasaku]
@ -8,7 +9,7 @@ summaly
 Installation
 ----------------------------------------------------------------
 ```
-npm install git+https://github.com/misskey-dev/summaly.git
+npm install @misskey-dev/summaly
 ```

 Usage
@ -21,8 +22,8 @@ import { summaly } from 'summaly';
 summaly(url[, opts])
 ```

-As Fastify plugin:  
-(will listen `GET` of `/url`)
+As Fastify plugin:
+(will listen `GET` of `/`)

 ```javascript
 import Summaly from 'summaly';
@ -40,71 +41,120 @@ npm run build
 npm run serve
 ```

-### Options
+#### opts (SummalyOptions)

-| Property            | Type                   | Description              | Default |
-| :------------------ | :--------------------- | :----------------------- | :------ |
-| **followRedirects** | *boolean*              | Whether follow redirects | `true`  |
-| **plugins**         | *plugin[]* (see below) | Custom plugins           | `null`  |
+| Property                  | Type                   | Description                                                                                                                                                                         | Default                |
+|:--------------------------|:-----------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------|
+| **lang**                  | *string*               | Accept-Language for the request                                                                                                                                                     | `null`                 |
+| **followRedirects**       | *boolean*              | Whether follow redirects                                                                                                                                                            | `true`                 |
+| **plugins**               | *plugin[]* (see below) | Custom plugins                                                                                                                                                                      | `null`                 |
+| **agent**                 | *Got.Agents*           | Custom HTTP agent (see below)                                                                                                                                                       | `null`                 |
+| **userAgent**             | *string*               | User-Agent for the request                                                                                                                                                          | `SummalyBot/[version]` |
+| **responseTimeout**       | *number*               | Set timeouts for each phase, such as host name resolution and socket communication.                                                                                                 | `20000`                |
+| **operationTimeout**      | *number*               | Set the timeout from the start to the end of the request.                                                                                                                           | `60000`                |
+| **contentLengthLimit**    | *number*               | If set to true, an error will occur if the content-length value returned from the other server is larger than this parameter (or if the received body size exceeds this parameter). | `10485760`             |
+| **contentLengthRequired** | *boolean*              | If set to true, it will be an error if the other server does not return content-length.                                                                                             | `false`                |

 #### Plugin

 ``` typescript
-interface IPlugin {
-	test: (url: URL.Url) => boolean;
-	summarize: (url: URL.Url) => Promise<Summary>;
+interface SummalyPlugin {
+	test: (url: URL) => boolean;
+	summarize: (url: URL) => Promise<Summary>;
 }
 ```

+urls are WHATWG URL since v4.
+
+#### Custom HTTP agent for proxy
+You can specify agents to be passed to Got for proxy use, etc.  
+https://github.com/sindresorhus/got/blob/v12.6.0/documentation/tips.md#proxying
+
+**⚠️If you set some agent, local IP rejecting will not work.⚠️**  
+(Summaly usually rejects local IPs.)
+
+(Summaly currently does not support http2.)
+
 ### Returns

 A Promise of an Object that contains properties below:

-※ Almost all values are nullable. player shoud not be null.
+※ Almost all values are nullable. player should not be null.

-#### Root
+#### SummalyResult

-| Property        | Type     | Description                              |
-| :-------------- | :------- | :--------------------------------------- |
-| **description** | *string* | The description of the web page          |
-| **icon**        | *string* | The url of the icon of the web page      |
-| **sitename**    | *string* | The name of the web site                 |
-| **thumbnail**   | *string* | The url of the thumbnail of the web page |
-| **player**      | *Player* | The player of the web page               |
-| **title**       | *string* | The title of the web page                |
-| **url**         | *string* | The url of the web page                  |
+| Property        | Type               | Description                                                |
+|:----------------|:-------------------|:-----------------------------------------------------------|
+| **title**       | *string* \| *null* | The title of the web page                                  |
+| **icon**        | *string* \| *null* | The url of the icon of the web page                        |
+| **description** | *string* \| *null* | The description of the web page                            |
+| **thumbnail**   | *string* \| *null* | The url of the thumbnail of the web page                   |
+| **sitename**    | *string* \| *null* | The name of the web site                                   |
+| **player**      | *Player*           | The player of the web page                                 |
+| **sensitive**   | *boolean*          | Whether the url is sensitive                               |
+| **activityPub** | *string* \| *null* | The url of the ActivityPub representation of that web page |
+| **url**         | *string*           | The url of the web page                                    |
+
+#### Summary
+
+`Omit<SummalyResult, "url">`

 #### Player

-| Property        | Type     | Description                              |
-| :-------------- | :------- | :--------------------------------------- |
-| **url**         | *string* | The url of the player                    |
-| **width**       | *number* | The width of the player                  |
-| **height**      | *number* | The height of the player                 |
+| Property   | Type               | Description                                     |
+|:-----------|:-------------------|:------------------------------------------------|
+| **url**    | *string* \| *null* | The url of the player                           |
+| **width**  | *number* \| *null* | The width of the player                         |
+| **height** | *number* \| *null* | The height of the player                        |
+| **allow**  | *string[]*         | The names of the allowed permissions for iframe |
+
+Currently the possible items in `allow` are:
+
+* `autoplay`
+* `clipboard-write`
+* `fullscreen`
+* `encrypted-media`
+* `picture-in-picture`
+* `web-share`
+
+See [Permissions Policy](https://developer.mozilla.org/en-US/docs/Web/HTTP/Permissions_Policy) in MDN for details of them.

 ### Example

-``` javascript
+```javascript
 import { summaly } from 'summaly';

 const summary = await summaly('https://www.youtube.com/watch?v=NMIEAhH_fTU');

-console.log(summary); // will be ... ↓
-/*
+console.log(summary);
+```
+
+will be ... ↓
+
+```json
 {
-	title: '【楽曲試聴】「Stage Bye Stage」(歌：島村卯月、渋谷凛、本田未央)',
-	icon: 'https://s.ytimg.com/yts/img/favicon-vfl8qSV2F.ico',
-	description: 'http://columbia.jp/idolmaster/ 2018年7月18日発売予定 THE IDOLM@STER CINDERELLA GIRLS CG STAR LIVE Stage Bye Stage 歌：島村卯月、渋谷凛、本田未央 COCC-17495［CD1枚組］ ￥1,200＋税 収録内容 Tr...',
-	thumbnail: 'https://i.ytimg.com/vi/NMIEAhH_fTU/maxresdefault.jpg',
-	player: {
-		url: 'https://www.youtube.com/embed/NMIEAhH_fTU',
-		width: 1280,
-		height: 720
+	"title": "【アイドルマスター】「Stage Bye Stage」(歌：島村卯月、渋谷凛、本田未央)",
+	"icon": "https://www.youtube.com/s/desktop/28b0985e/img/favicon.ico",
+	"description": "Website▶https://columbia.jp/idolmaster/Playlist▶https://www.youtube.com/playlist?list=PL83A2998CF3BBC86D2018年7月18日発売予定THE IDOLM@STER CINDERELLA GIRLS CG STAR...",
+	"thumbnail": "https://i.ytimg.com/vi/NMIEAhH_fTU/maxresdefault.jpg",
+	"player": {
+		"url": "https://www.youtube.com/embed/NMIEAhH_fTU?feature=oembed",
+		"width": 200,
+		"height": 113,
+		"allow": [
+			"autoplay",
+			"clipboard-write",
+			"encrypted-media",
+			"picture-in-picture",
+			"web-share",
+			"fullscreen",
+		]
 	},
-	sitename: 'YouTube',
-	url: 'https://www.youtube.com/watch?v=NMIEAhH_fTU'
+	"sitename": "YouTube",
+	"sensitive": false,
+	"activityPub": null,
+	"url": "https://www.youtube.com/watch?v=NMIEAhH_fTU"
 }
-*/
 ```

 Testing
@ -115,12 +165,10 @@ License
 ----------------------------------------------------------------
 [MIT](LICENSE)

-[npm-link]:       https://www.npmjs.com/package/summaly
-[npm-badge]:      https://img.shields.io/npm/v/summaly.svg?style=flat-square
 [mit]:            http://opensource.org/licenses/MIT
 [mit-badge]:      https://img.shields.io/badge/license-MIT-444444.svg?style=flat-square
-[travis-link]:    https://travis-ci.org/syuilo/summaly
-[travis-badge]:   http://img.shields.io/travis/syuilo/summaly.svg?style=flat-square
 [himasaku]:       https://himasaku.net
 [himawari-badge]: https://img.shields.io/badge/%E5%8F%A4%E8%B0%B7-%E5%90%91%E6%97%A5%E8%91%B5-1684c5.svg?style=flat-square
 [sakurako-badge]: https://img.shields.io/badge/%E5%A4%A7%E5%AE%A4-%E6%AB%BB%E5%AD%90-efb02a.svg?style=flat-square
+[npm-link]:       https://www.npmjs.com/package/@misskey-dev/summaly
+[npm-badge]:      https://img.shields.io/npm/v/@misskey-dev/summaly.svg?style=flat-square
--- a/package-lock.json
+++ b/package-lock.json
--- a/package.json
+++ b/package.json
@ -1,6 +1,6 @@
 {
-  "name": "summaly",
-  "version": "3.0.0-alpha.1",
+  "name": "@misskey-dev/summaly",
+  "version": "5.1.0",
  "description": "Get web page's summary",
  "author": "syuilo <syuilotan@yahoo.co.jp>",
  "license": "MIT",
@ -9,42 +9,43 @@
  "main": "./built/index.js",
  "type": "module",
  "types": "./built/index.d.ts",
+  "packageManager": "pnpm@8.13.1",
  "files": [
    "built",
    "LICENSE"
  ],
  "scripts": {
    "build": "tsc",
+    "eslint": "eslint src --ext .js,.jsx,.ts,.tsx",
    "test": "node --experimental-vm-modules node_modules/jest/bin/jest.js --silent=false --verbose false",
    "serve": "fastify start ./built/index.js"
  },
-  "optionalDependencies": {
-    "fastify": "3.24.1"
-  },
  "devDependencies": {
-    "@jest/globals": "^29.4.2",
-    "@swc/core": "^1.3.35",
-    "@swc/jest": "^0.2.24",
+    "@jest/globals": "^29.7.0",
+    "@misskey-dev/eslint-plugin": "^1.0.0",
+    "@swc/core": "^1.3.101",
+    "@swc/jest": "^0.2.29",
    "@types/cheerio": "0.22.18",
    "@types/debug": "4.1.7",
    "@types/escape-regexp": "^0.0.1",
-    "@types/html-entities": "1.3.4",
-    "@types/node": "16.11.12",
+    "@types/node": "20.10.6",
+    "@typescript-eslint/eslint-plugin": "^6.16.0",
+    "@typescript-eslint/parser": "^6.16.0",
    "debug": "^4.3.4",
-    "express": "^4.18.2",
-    "fastify": "^4.13.0",
-    "fastify-cli": "^5.7.1",
-    "jest": "^29.4.2",
-    "typescript": "4.5.3"
+    "eslint": "^8.56.0",
+    "eslint-plugin-import": "^2.29.1",
+    "fastify": "^4.25.2",
+    "fastify-cli": "^5.9.0",
+    "jest": "^29.7.0",
+    "typescript": "5.3.3"
  },
  "dependencies": {
-    "cheerio": "^1.0.0-rc.12",
+    "cheerio": "1.0.0-rc.12",
    "escape-regexp": "0.0.1",
-    "got": "^12.5.3",
+    "got": "^12.6.1",
    "html-entities": "2.3.2",
    "iconv-lite": "0.6.3",
    "jschardet": "3.0.0",
-    "koa": "2.13.4",
    "private-ip": "2.3.3",
    "trace-redirect": "1.0.6"
  }
--- a/pnpm-lock.yaml
+++ b/pnpm-lock.yaml
--- a/src/general.ts
+++ b/src/general.ts
@ -1,24 +1,177 @@
-import * as URL from 'node:url';
+import { URL } from 'node:url';
+import { decode as decodeHtml } from 'html-entities';
+import * as cheerio from 'cheerio';
 import clip from './utils/clip.js';
 import cleanupTitle from './utils/cleanup-title.js';

-import { decode as decodeHtml } from 'html-entities';
+import { get, head, scpaping } from './utils/got.js';
+import type { default as Summary, Player } from './summary.js';

-import { head, scpaping } from './utils/got.js';
-import Summary from './summary.js';
+/**
+ * Contains only the html snippet for a sanitized iframe as the thumbnail is
+ * mostly covered in OpenGraph instead.
+ *
+ * Width should always be 100%.
+ */
+async function getOEmbedPlayer($: cheerio.CheerioAPI, pageUrl: string): Promise<Player | null> {
+	const href = $('link[type="application/json+oembed"]').attr('href');
+	if (!href) {
+		return null;
+	}

-export default async (url: URL.Url, lang: string | null = null): Promise<Summary | null> => {
+	const oEmbedUrl = (() => {
+		try {
+			return new URL(href, pageUrl);
+		} catch { return null; }
+	})();
+	if (!oEmbedUrl) {
+		return null;
+	}
+
+	const oEmbed = await get(oEmbedUrl.href).catch(() => null);
+	if (!oEmbed) {
+		return null;
+	}
+
+	const body = (() => {
+		try {
+			return JSON.parse(oEmbed);
+		} catch { /* empty */ }
+	})();
+
+	if (!body || body.version !== '1.0' || !['rich', 'video'].includes(body.type)) {
+		// Not a well formed rich oEmbed
+		return null;
+	}
+
+	if (!body.html.startsWith('<iframe ') || !body.html.endsWith('</iframe>')) {
+		// It includes something else than an iframe
+		return null;
+	}
+
+	const oEmbedHtml = cheerio.load(body.html);
+	const iframe = oEmbedHtml('iframe');
+
+	if (iframe.length !== 1) {
+		// Somehow we either have multiple iframes or none
+		return null;
+	}
+
+	if (iframe.parents().length !== 2) {
+		// Should only have the body and html elements as the parents
+		return null;
+	}
+
+	const url = iframe.attr('src');
+	if (!url) {
+		// No src?
+		return null;
+	}
+
+	try {
+		if ((new URL(url)).protocol !== 'https:') {
+			// Allow only HTTPS for best security
+			return null;
+		}
+	} catch (e) {
+		return null;
+	}
+
+	// Height is the most important, width is okay to be null. The implementer
+	// should choose fixed height instead of fixed aspect ratio if width is null.
+	//
+	// For example, Spotify's embed page does not strictly follow aspect ratio
+	// and thus keeping the height is better than keeping the aspect ratio.
+	//
+	// Spotify gives `width: 100%, height: 152px` for iframe while `width: 456,
+	// height: 152` for oEmbed data, and we treat any percentages as null here.
+	let width: number | null = Number(iframe.attr('width') ?? body.width);
+	if (Number.isNaN(width)) {
+		width = null;
+	}
+	const height = Math.min(Number(iframe.attr('height') ?? body.height), 1024);
+	if (Number.isNaN(height)) {
+		// No proper height info
+		return null;
+	}
+
+	// TODO: This implementation only allows basic syntax of `allow`.
+	// Might need to implement better later.
+	const safeList = [
+		'autoplay',
+		'clipboard-write',
+		'fullscreen',
+		'encrypted-media',
+		'picture-in-picture',
+		'web-share',
+	];
+	// YouTube has these but they are almost never used.
+	const ignoredList = [
+		'gyroscope',
+		'accelerometer',
+	];
+	const allowedPermissions =
+		(iframe.attr('allow') ?? '').split(/\s*;\s*/g)
+			.filter(s => s)
+			.filter(s => !ignoredList.includes(s));
+	if (iframe.attr('allowfullscreen') === '') {
+		allowedPermissions.push('fullscreen');
+	}
+	if (allowedPermissions.some(allow => !safeList.includes(allow))) {
+		// This iframe is probably too powerful to be embedded
+		return null;
+	}
+
+	return {
+		url,
+		width,
+		height,
+		allow: allowedPermissions,
+	};
+}
+
+export type GeneralScrapingOptions = {
+	lang?: string | null;
+	userAgent?: string;
+	responseTimeout?: number;
+	operationTimeout?: number;
+	contentLengthLimit?: number;
+	contentLengthRequired?: boolean;
+}
+
+export default async (_url: URL | string, opts?: GeneralScrapingOptions): Promise<Summary | null> => {
+	let lang = opts?.lang;
+	// eslint-disable-next-line no-param-reassign
 	if (lang && !lang.match(/^[\w-]+(\s*,\s*[\w-]+)*$/)) lang = null;

-	const res = await scpaping(url.href, { lang: lang || undefined });
+	const url = typeof _url === 'string' ? new URL(_url) : _url;
+
+	const res = await scpaping(url.href, {
+		lang: lang || undefined,
+		userAgent: opts?.userAgent,
+		responseTimeout: opts?.responseTimeout,
+		operationTimeout: opts?.operationTimeout,
+		contentLengthLimit: opts?.contentLengthLimit,
+		contentLengthRequired: opts?.contentLengthRequired,
+	});
 	const $ = res.$;
-	const twitterCard = $('meta[property="twitter:card"]').attr('content');
+	const twitterCard =
+		$('meta[name="twitter:card"]').attr('content') ||
+		$('meta[property="twitter:card"]').attr('content');
+
+	// According to docs, name attribute of meta tag is used for twitter card but for compatibility,
+	// this library will also look for property attribute.
+	// See https://developer.twitter.com/en/docs/twitter-for-websites/cards/overview/summary
+	// Property attribute is used for open graph.
+	// See https://ogp.me/

 	let title: string | null | undefined =
 		$('meta[property="og:title"]').attr('content') ||
+		$('meta[name="twitter:title"]').attr('content') ||
 		$('meta[property="twitter:title"]').attr('content') ||
 		$('title').text();

+	// eslint-disable-next-line @typescript-eslint/no-unnecessary-condition
 	if (title === undefined || title === null) {
 		return null;
 	}
@ -27,34 +180,36 @@ export default async (url: URL.Url, lang: string | null = null): Promise<Summary

 	let image: string | null | undefined =
 		$('meta[property="og:image"]').attr('content') ||
+		$('meta[name="twitter:image"]').attr('content') ||
 		$('meta[property="twitter:image"]').attr('content') ||
 		$('link[rel="image_src"]').attr('href') ||
 		$('link[rel="apple-touch-icon"]').attr('href') ||
 		$('link[rel="apple-touch-icon image_src"]').attr('href');

-	image = image ? URL.resolve(url.href, image) : null;
+	image = image ? (new URL(image, url.href)).href : null;

 	const playerUrl =
-		(twitterCard !== 'summary_large_image' && $('meta[property="twitter:player"]').attr('content')) ||
 		(twitterCard !== 'summary_large_image' && $('meta[name="twitter:player"]').attr('content')) ||
+		(twitterCard !== 'summary_large_image' && $('meta[property="twitter:player"]').attr('content')) ||
 		$('meta[property="og:video"]').attr('content') ||
 		$('meta[property="og:video:secure_url"]').attr('content') ||
 		$('meta[property="og:video:url"]').attr('content');

 	const playerWidth = parseInt(
-		$('meta[property="twitter:player:width"]').attr('content') ||
 		$('meta[name="twitter:player:width"]').attr('content') ||
+		$('meta[property="twitter:player:width"]').attr('content') ||
 		$('meta[property="og:video:width"]').attr('content') ||
 		'');

 	const playerHeight = parseInt(
-		$('meta[property="twitter:player:height"]').attr('content') ||
 		$('meta[name="twitter:player:height"]').attr('content') ||
+		$('meta[property="twitter:player:height"]').attr('content') ||
 		$('meta[property="og:video:height"]').attr('content') ||
 		'');

 	let description: string | null | undefined =
 		$('meta[property="og:description"]').attr('content') ||
+		$('meta[name="twitter:description"]').attr('content') ||
 		$('meta[property="twitter:description"]').attr('content') ||
 		$('meta[name="description"]').attr('content');

@ -66,48 +221,42 @@ export default async (url: URL.Url, lang: string | null = null): Promise<Summary
 		description = null;
 	}

-	let siteName =
+	const siteName = decodeHtml(
 		$('meta[property="og:site_name"]').attr('content') ||
 		$('meta[name="application-name"]').attr('content') ||
-		url.hostname;
-
-	siteName = siteName ? decodeHtml(siteName) : null;
+		url.host,
+	);

 	const favicon =
 		$('link[rel="shortcut icon"]').attr('href') ||
 		$('link[rel="icon"]').attr('href') ||
 		'/favicon.ico';

-	const sensitive = $('.tweet').attr('data-possibly-sensitive') === 'true'
+	const activityPub =
+		$('link[rel="alternate"][type="application/activity+json"]').attr('href') || null;
+
+	// https://developer.mixi.co.jp/connect/mixi_plugin/mixi_check/spec_mixi_check/#toc-18-
+	const sensitive =
+		$('meta[property=\'mixi:content-rating\']').attr('content') === '1';

 	const find = async (path: string) => {
-		const target = URL.resolve(url.href, path);
+		const target = new URL(path, url.href);
 		try {
-			await head(target);
+			await head(target.href);
 			return target;
 		} catch (e) {
 			return null;
 		}
 	};

-	// 相対的なURL (ex. test) を絶対的 (ex. /test) に変換
-	const toAbsolute = (relativeURLString: string): string => {
-		const relativeURL = URL.parse(relativeURLString);
-		const isAbsolute = relativeURL.slashes || relativeURL.path !== null && relativeURL.path[0] === '/';
-
-		// 既に絶対的なら、即座に値を返却
-		if (isAbsolute) {
-			return relativeURLString;
-		}
-
-		// スラッシュを付けて返却
-		return '/' + relativeURLString;
+	const getIcon = async () => {
+		return (await find(favicon)) || null;
 	};

-	const icon = await find(favicon) ||
-		// 相対指定を絶対指定に変換し再試行
-		await find(toAbsolute(favicon)) ||
-		null;
+	const [icon, oEmbed] = await Promise.all([
+		getIcon(),
+		getOEmbedPlayer($, url.href),
+	]);

 	// Clean up the title
 	title = cleanupTitle(title, siteName);
@ -118,15 +267,17 @@ export default async (url: URL.Url, lang: string | null = null): Promise<Summary

 	return {
 		title: title || null,
-		icon: icon || null,
+		icon: icon?.href || null,
 		description: description || null,
 		thumbnail: image || null,
-		player: {
+		player: oEmbed ?? {
 			url: playerUrl || null,
 			width: Number.isNaN(playerWidth) ? null : playerWidth,
-			height: Number.isNaN(playerHeight) ? null : playerHeight
+			height: Number.isNaN(playerHeight) ? null : playerHeight,
+			allow: ['autoplay', 'encrypted-media', 'fullscreen'],
 		},
 		sitename: siteName || null,
 		sensitive,
+		activityPub,
 	};
 };
--- a/src/index.ts
+++ b/src/index.ts
@ -1,20 +1,20 @@
 /**
 * summaly
- * https://github.com/syuilo/summaly
+ * https://github.com/misskey-dev/summaly
 */

-import * as URL from 'node:url';
+import { URL } from 'node:url';
 import tracer from 'trace-redirect';
-import Summary from './summary.js';
-import type { IPlugin as _IPlugin } from './iplugin.js';
-export type IPlugin = _IPlugin;
-import general from './general.js';
 import * as Got from 'got';
+import { SummalyResult } from './summary.js';
+import { SummalyPlugin } from './iplugin.js';
+export * from './iplugin.js';
+import general, { GeneralScrapingOptions } from './general.js';
 import { setAgent } from './utils/got.js';
-import type { FastifyInstance } from 'fastify';
 import { plugins as builtinPlugins } from './plugins/index.js';
+import type { FastifyInstance } from 'fastify';

-type Options = {
+export type SummalyOptions = {
 	/**
 	 * Accept-Language for the request
 	 */
@ -28,34 +28,56 @@ type Options = {
 	/**
 	 * Custom Plugins
 	 */
-	plugins?: IPlugin[];
+	plugins?: SummalyPlugin[];

 	/**
 	 * Custom HTTP agent
 	 */
 	agent?: Got.Agents;
-};

-type Result = Summary & {
 	/**
-	 * The actual url of that web page
+	 * User-Agent for the request
 	 */
-	url: string;
+	userAgent?: string;
+
+	/**
+	 * Response timeout.
+	 * Set timeouts for each phase, such as host name resolution and socket communication.
+	 */
+	responseTimeout?: number;
+
+	/**
+	 * Operation timeout.
+	 * Set the timeout from the start to the end of the request.
+	 */
+	operationTimeout?: number;
+
+	/**
+	 * Maximum content length.
+	 * If set to true, an error will occur if the content-length value returned from the other server is larger than this parameter (or if the received body size exceeds this parameter).
+	 */
+	contentLengthLimit?: number;
+
+	/**
+	 * Content length required.
+	 * If set to true, it will be an error if the other server does not return content-length.
+	 */
+	contentLengthRequired?: boolean;
 };

-const defaultOptions = {
+export const summalyDefaultOptions = {
 	lang: null,
 	followRedirects: true,
 	plugins: [],
-} as Options;
+} as SummalyOptions;

 /**
 * Summarize an web page
 */
-export const summaly = async (url: string, options?: Options): Promise<Result> => {
+export const summaly = async (url: string, options?: SummalyOptions): Promise<SummalyResult> => {
 	if (options?.agent) setAgent(options.agent);

-	const opts = Object.assign(defaultOptions, options);
+	const opts = Object.assign(summalyDefaultOptions, options);

 	const plugins = builtinPlugins.concat(opts.plugins || []);

@ -68,35 +90,46 @@ export const summaly = async (url: string, options?: Options): Promise<Result> =
 			actualUrl = url;
 		}
 	}
- 
-	const _url = URL.parse(actualUrl, true);
+
+	const _url = new URL(actualUrl);

 	// Find matching plugin
 	const match = plugins.filter(plugin => plugin.test(_url))[0];

 	// Get summary
-	const summary = await (match ? match.summarize : general)(_url, opts.lang || undefined);
+	const scrapingOptions: GeneralScrapingOptions = {
+		lang: opts.lang,
+		userAgent: opts.userAgent,
+		responseTimeout: opts.responseTimeout,
+		operationTimeout: opts.operationTimeout,
+		contentLengthLimit: opts.contentLengthLimit,
+		contentLengthRequired: opts.contentLengthRequired,
+	};
+
+	// eslint-disable-next-line @typescript-eslint/no-unnecessary-condition
+	const summary = await (match ? match.summarize : general)(_url, scrapingOptions);

 	if (summary == null) {
-		throw 'failed summarize';
+		throw new Error('failed summarize');
 	}

 	return Object.assign(summary, {
-		url: actualUrl
+		url: actualUrl,
 	});
 };

-export default function (fastify: FastifyInstance, options: Options, done: (err?: Error) => void) {
+export default function (fastify: FastifyInstance, options: SummalyOptions, done: (err?: Error) => void) {
 	fastify.get<{
        Querystring: {
 				url?: string;
 				lang?: string;
 			};
-	}>('/url', async (req, reply) => {
+	}>('/', async (req, reply) => {
 		const url = req.query.url as string;
+		// eslint-disable-next-line @typescript-eslint/no-unnecessary-condition
 		if (url == null) {
 			return reply.status(400).send({
-				error: 'url is required'
+				error: 'url is required',
 			});
 		}

@ -110,10 +143,10 @@ export default function (fastify: FastifyInstance, options: Options, done: (err?
 			return summary;
 		} catch (e) {
 			return reply.status(500).send({
-				error: e
+				error: e,
 			});
 		}
 	});

 	done();
-}
+}
--- a/src/iplugin.ts
+++ b/src/iplugin.ts
@ -1,7 +1,8 @@
-import * as URL from 'node:url';
 import Summary from './summary.js';
+import type { URL } from 'node:url';
+import { GeneralScrapingOptions } from '@/general';

-export interface IPlugin {
-	test: (url: URL.Url) => boolean;
-	summarize: (url: URL.Url, lang?: string) => Promise<Summary>;
+export interface SummalyPlugin {
+	test: (url: URL) => boolean;
+	summarize: (url: URL, opts?: GeneralScrapingOptions) => Promise<Summary | null>;
 }
--- a/src/plugins/amazon.ts
+++ b/src/plugins/amazon.ts
@ -1,8 +1,8 @@
-import * as URL from 'node:url';
+import { URL } from 'node:url';
 import { scpaping } from '../utils/got.js';
 import summary from '../summary.js';

-export function test(url: URL.Url): boolean {
+export function test(url: URL): boolean {
 	return url.hostname === 'www.amazon.com' ||
 	url.hostname === 'www.amazon.co.jp' ||
 	url.hostname === 'www.amazon.ca' ||
@ -19,7 +19,7 @@ export function test(url: URL.Url): boolean {
 	url.hostname === 'www.amazon.au';
 }

-export async function summarize(url: URL.Url): Promise<summary> {
+export async function summarize(url: URL): Promise<summary> {
 	const res = await scpaping(url.href);
 	const $ = res.$;

@ -51,8 +51,10 @@ export async function summarize(url: URL.Url): Promise<summary> {
 		player: {
 			url: playerUrl || null,
 			width: playerWidth ? parseInt(playerWidth) : null,
-			height: playerHeight ? parseInt(playerHeight) : null
+			height: playerHeight ? parseInt(playerHeight) : null,
+			allow: playerUrl ? ['fullscreen', 'encrypted-media'] : [],
 		},
-		sitename: 'Amazon'
+		sitename: 'Amazon',
+		activityPub: null,
 	};
 }
--- a/src/plugins/branchio-deeplinks.ts
+++ b/src/plugins/branchio-deeplinks.ts
@ -0,0 +1,17 @@
+import { URL } from 'node:url';
+import general, { GeneralScrapingOptions } from '../general.js';
+import Summary from '../summary.js';
+
+export function test(url: URL): boolean {
+	// Branch.io を使用したディープリンクにマッチ
+	return /^[a-zA-Z0-9]+\.app\.link$/.test(url.hostname) ||
+	url.hostname === 'spotify.link';
+}
+
+export async function summarize(url: URL, opts?: GeneralScrapingOptions): Promise<Summary | null> {
+	// https://help.branch.io/using-branch/docs/creating-a-deep-link#redirections
+	// Web版に強制リダイレクトすることでbranch.ioの独自ページが開くのを防ぐ
+	url.searchParams.append('$web_only', 'true');
+
+	return await general(url, opts);
+}
--- a/src/plugins/index.ts
+++ b/src/plugins/index.ts
@ -1,8 +1,10 @@
-import { IPlugin } from '@/iplugin.js';
 import * as amazon from './amazon.js';
 import * as wikipedia from './wikipedia.js';
+import * as branchIoDeeplinks from './branchio-deeplinks.js';
+import { SummalyPlugin } from '@/iplugin.js';

-export const plugins: IPlugin[] = [
-    amazon,
-    wikipedia,
+export const plugins: SummalyPlugin[] = [
+	amazon,
+	wikipedia,
+	branchIoDeeplinks,
 ];
--- a/src/plugins/wikipedia.ts
+++ b/src/plugins/wikipedia.ts
@ -1,17 +1,17 @@
-import * as URL from 'node:url';
-import { get } from '../utils/got.js';
+import { URL } from 'node:url';
 import debug from 'debug';
+import { get } from '../utils/got.js';
 import summary from '../summary.js';
 import clip from './../utils/clip.js';

 const log = debug('summaly:plugins:wikipedia');

-export function test(url: URL.Url): boolean {
+export function test(url: URL): boolean {
 	if (!url.hostname) return false;
 	return /\.wikipedia\.org$/.test(url.hostname);
 }

-export async function summarize(url: URL.Url): Promise<summary> {
+export async function summarize(url: URL): Promise<summary> {
 	const lang = url.host ? url.host.split('.')[0] : null;
 	const title = url.pathname ? url.pathname.split('/')[2] : null;
 	const endpoint = `https://${lang}.wikipedia.org/w/api.php?format=json&action=query&prop=extracts&exintro=&explaintext=&titles=${title}`;
@ -20,12 +20,13 @@ export async function summarize(url: URL.Url): Promise<summary> {
 	log(`title is ${title}`);
 	log(`endpoint is ${endpoint}`);

+	// eslint-disable-next-line @typescript-eslint/no-explicit-any
 	let body = await get(endpoint) as any;
 	body = JSON.parse(body);
 	log(body);

 	if (!('query' in body) || !('pages' in body.query)) {
-		throw 'fetch failed';
+		throw new Error('fetch failed');
 	}

 	const info = body.query.pages[Object.keys(body.query.pages)[0]];
@ -38,8 +39,10 @@ export async function summarize(url: URL.Url): Promise<summary> {
 		player: {
 			url: null,
 			width: null,
-			height: null
+			height: null,
+			allow: [],
 		},
-		sitename: 'Wikipedia'
+		sitename: 'Wikipedia',
+		activityPub: null,
 	};
 }
--- a/src/summary.ts
+++ b/src/summary.ts
@ -1,8 +1,8 @@
 type Summary = {
 	/**
-	 * The description of that web page
+	 * The title of that web page
 	 */
-	description: string | null;
+	title: string | null;

 	/**
 	 * The url of the icon of that web page
@ -10,29 +10,41 @@ type Summary = {
 	icon: string | null;

 	/**
-	 * The name of site of that web page
+	 * The description of that web page
 	 */
-	sitename: string | null;
+	description: string | null;

 	/**
 	 * The url of the thumbnail of that web page
 	 */
 	thumbnail: string | null;

+	/**
+	 * The name of site of that web page
+	 */
+	sitename: string | null;
+
 	/**
 	 * The player of that web page
 	 */
 	player: Player;

-	/**
-	 * The title of that web page
-	 */
-	title: string | null;
-
 	/**
 	 * Possibly sensitive
 	 */
 	sensitive?: boolean;
+
+	/**
+	 * The url of the ActivityPub representation of that web page
+	 */
+	activityPub: string | null;
+};
+
+export type SummalyResult = Summary & {
+	/**
+	 * The actual url of that web page
+	 */
+	url: string;
 };

 export default Summary;
@ -52,4 +64,9 @@ export type Player = {
 	 * The height of the player
 	 */
 	height: number | null;
+
+	/**
+	 * The allowed permissions of the iframe
+	 */
+	allow: string[];
 };
--- a/src/utils/cleanup-title.ts
+++ b/src/utils/cleanup-title.ts
@ -1,3 +1,4 @@
+/* eslint-disable no-param-reassign */
 import escapeRegExp from 'escape-regexp';

 export default function(title: string, siteName?: string | null): string {
@ -9,12 +10,12 @@ export default function(title: string, siteName?: string | null): string {
 		const x = escapeRegExp(siteName);

 		const patterns = [
-			`^(.+?)\\s?[\\-\\|:・]\\s?${x}$`
+			`^(.+?)\\s?[\\-\\|:・]\\s?${x}$`,
 		];

 		for (let i = 0; i < patterns.length; i++) {
 			const pattern = new RegExp(patterns[i]);
-			const [, match] = pattern.exec(title) || [null, null];
+			const [, match] = pattern.exec(title) ?? [null, null];
 			if (match) {
 				return match;
 			}
--- a/src/utils/clip.ts
+++ b/src/utils/clip.ts
@ -5,6 +5,7 @@ export default function(s: string, max: number): string {
 		return s;
 	}

+	// eslint-disable-next-line no-param-reassign
 	s = s.trim();

 	if (s.length > max) {
--- a/src/utils/encoding.ts
+++ b/src/utils/encoding.ts
@ -11,6 +11,7 @@ const regCharset = new RegExp(/charset\s*=\s*["']?([\w-]+)/, 'i');
 export function detectEncoding(body: Buffer): string {
 	// By detection
 	const detected = jschardet.detect(body, { minimumThreshold: 0.99 });
+	// eslint-disable-next-line @typescript-eslint/no-unnecessary-condition
 	if (detected) {
 		const candicate = detected.encoding;
 		const encoding = toEncoding(candicate);
--- a/src/utils/got.ts
+++ b/src/utils/got.ts
@ -1,17 +1,19 @@
-import got, * as Got from 'got';
-import { StatusError } from './status-error.js';
-import { detectEncoding, toUtf8 } from './encoding.js';
-import * as cheerio from 'cheerio';
-import PrivateIp from 'private-ip';
 import { dirname } from 'node:path';
 import { fileURLToPath } from 'node:url';
 import { readFileSync } from 'node:fs';
+import got, * as Got from 'got';
+import * as cheerio from 'cheerio';
+import PrivateIp from 'private-ip';
+import { StatusError } from './status-error.js';
+import { detectEncoding, toUtf8 } from './encoding.js';

 const _filename = fileURLToPath(import.meta.url);
 const _dirname = dirname(_filename);

 export let agent: Got.Agents = {};
+
 export function setAgent(_agent: Got.Agents) {
+	// eslint-disable-next-line @typescript-eslint/no-unnecessary-condition
 	agent = _agent || {};
 }

@ -21,34 +23,60 @@ export type GotOptions = {
 	body?: string;
 	headers: Record<string, string | undefined>;
 	typeFilter?: RegExp;
+	responseTimeout?: number;
+	operationTimeout?: number;
+	contentLengthLimit?: number;
+	contentLengthRequired?: boolean;
 }

 const repo = JSON.parse(readFileSync(`${_dirname}/../../package.json`, 'utf8'));

-const RESPONSE_TIMEOUT = 20 * 1000;
-const OPERATION_TIMEOUT = 60 * 1000;
-const MAX_RESPONSE_SIZE = 10 * 1024 * 1024;
-const BOT_UA = `SummalyBot/${repo.version}`;
+const DEFAULT_RESPONSE_TIMEOUT = 20 * 1000;
+const DEFAULT_OPERATION_TIMEOUT = 60 * 1000;
+const DEFAULT_MAX_RESPONSE_SIZE = 10 * 1024 * 1024;
+const DEFAULT_BOT_UA = `SummalyBot/${repo.version}`;

-export async function scpaping(url: string, opts?: { lang?: string; }) {
-	const response = await getResponse({
+export async function scpaping(
+	url: string,
+	opts?: {
+		lang?: string;
+		userAgent?: string;
+		responseTimeout?: number;
+		operationTimeout?: number;
+		contentLengthLimit?: number;
+		contentLengthRequired?: boolean;
+	},
+) {
+	const args: Omit<GotOptions, 'method'> = {
 		url,
-		method: 'GET',
 		headers: {
 			'accept': 'text/html,application/xhtml+xml',
-			'user-agent': BOT_UA,
-			'accept-language': opts?.lang
+			'user-agent': opts?.userAgent ?? DEFAULT_BOT_UA,
+			'accept-language': opts?.lang,
 		},
 		typeFilter: /^(text\/html|application\/xhtml\+xml)/,
+		responseTimeout: opts?.responseTimeout,
+		operationTimeout: opts?.operationTimeout,
+		contentLengthLimit: opts?.contentLengthLimit,
+		contentLengthRequired: opts?.contentLengthRequired,
+	};
+
+	const headResponse = await getResponse({
+		...args,
+		method: 'HEAD',
 	});

-	// テスト用
-	const allowPrivateIp = process.env.SUMMALY_ALLOW_PRIVATE_IP === 'true';
-
-	if (!allowPrivateIp && response.ip && PrivateIp(response.ip)) {
-		throw new StatusError(`Private IP rejected ${response.ip}`, 400, 'Private IP Rejected');
+	// SUMMALY_ALLOW_PRIVATE_IPはテスト用
+	const allowPrivateIp = process.env.SUMMALY_ALLOW_PRIVATE_IP === 'true' || Object.keys(agent).length > 0;
+	if (!allowPrivateIp && headResponse.ip && PrivateIp(headResponse.ip)) {
+		throw new StatusError(`Private IP rejected ${headResponse.ip}`, 400, 'Private IP Rejected');
 	}

+	const response = await getResponse({
+		...args,
+		method: 'GET',
+	});
+
 	const encoding = detectEncoding(response.rawBody);
 	const body = toUtf8(response.rawBody, encoding);
 	const $ = cheerio.load(body);
@ -69,24 +97,22 @@ export async function get(url: string) {
 		},
 	});

-	return await res.body;
+	return res.body;
 }

 export async function head(url: string) {
-	const res = await getResponse({
+	return await getResponse({
 		url,
 		method: 'HEAD',
 		headers: {
 			'accept': '*/*',
 		},
 	});
-
-	return await res;
 }

 async function getResponse(args: GotOptions) {
-	const timeout = RESPONSE_TIMEOUT;
-	const operationTimeout = OPERATION_TIMEOUT;
+	const timeout = args.responseTimeout ?? DEFAULT_RESPONSE_TIMEOUT;
+	const operationTimeout = args.operationTimeout ?? DEFAULT_OPERATION_TIMEOUT;

 	const req = got<string>(args.url, {
 		method: args.method,
@ -108,29 +134,37 @@ async function getResponse(args: GotOptions) {
 		},
 	});

-	return await receiveResponce({ req, typeFilter: args.typeFilter });
+	const res = await receiveResponse({ req, opts: args });
+
+	// Check html
+	const contentType = res.headers['content-type'];
+	if (args.typeFilter && !contentType?.match(args.typeFilter)) {
+		throw new Error(`Rejected by type filter ${contentType}`);
+	}
+
+	// 応答ヘッダでサイズチェック
+	const contentLength = res.headers['content-length'];
+	if (contentLength) {
+		const maxSize = args.contentLengthLimit ?? DEFAULT_MAX_RESPONSE_SIZE;
+		const size = Number(contentLength);
+		if (size > maxSize) {
+			throw new Error(`maxSize exceeded (${size} > ${maxSize}) on response`);
+		}
+	} else {
+		if (args.contentLengthRequired) {
+			throw new Error('content-length required');
+		}
+	}
+
+	return res;
 }

-async function receiveResponce<T>(args: { req: Got.CancelableRequest<Got.Response<T>>, typeFilter?: RegExp }) {
+async function receiveResponse<T>(args: {
+	req: Got.CancelableRequest<Got.Response<T>>,
+	opts: GotOptions,
+}) {
 	const req = args.req;
-	const maxSize = MAX_RESPONSE_SIZE;
-
-	req.on('response', (res: Got.Response) => {
-		// Check html
-		if (args.typeFilter && !res.headers['content-type']?.match(args.typeFilter)) {
-			req.cancel(`Rejected by type filter ${res.headers['content-type']}`);
-			return;
-		}
-
-		// 応答ヘッダでサイズチェック
-		const contentLength = res.headers['content-length'];
-		if (contentLength != null) {
-			const size = Number(contentLength);
-			if (size > maxSize) {
-				req.cancel(`maxSize exceeded (${size} > ${maxSize}) on response`);
-			}
-		}
-	});
+	const maxSize = args.opts.contentLengthLimit ?? DEFAULT_MAX_RESPONSE_SIZE;

 	// 受信中のデータでサイズチェック
 	req.on('downloadProgress', (progress: Got.Progress) => {
--- a/src/utils/null-or-empty.ts
+++ b/src/utils/null-or-empty.ts
@ -1,3 +1,4 @@
+/* eslint-disable @typescript-eslint/no-unnecessary-condition */
 export default function(val: string): boolean {
 	if (val === undefined) {
 		return true;
--- a/src/utils/status-error.ts
+++ b/src/utils/status-error.ts
@ -1,4 +1,5 @@
 export class StatusError extends Error {
+	public name: string;
 	public statusCode: number;
 	public statusMessage?: string;
 	public isPermanentError: boolean;
--- a/test/htmls/activitypub.html
+++ b/test/htmls/activitypub.html
@ -0,0 +1,3 @@
+<!DOCTYPE html>
+<meta charset="utf-8">
+<link rel="alternate" type="application/activity+json" href="https://misskey.test/notes/abcdefg">
--- a/test/htmls/basic.html
+++ b/test/htmls/basic.html
@ -7,6 +7,6 @@
 	</head>
 	<body>
 		<h1>KISS principle</h1>
-		<p>KISS is an acronym for "Keep it simple, stupid" as a design principle noted by the U.S. Navy in 1960.</p>
+		<p>KISS is an acronym for ”Keep it simple, stupid” as a design principle noted by the U.S. Navy in 1960.</p>
 	</body>
 </html>
--- a/test/htmls/dirty-title.html
+++ b/test/htmls/dirty-title.html
@ -1,9 +1,13 @@
 <!doctype html>

-<html>
+<html lang="en">
 	<head>
 		<meta charset="utf-8">
 		<meta property="og:site_name" content="Alice's Site">
 		<title>Strawberry Pasta | Alice's Site</title>
 	</head>
+	<body>
+		<h1>Strawberry Pasta</h1>
+		<p>Strawberry pasta is a kind of pasta with strawberry sauce.</p>
+	</body>
 </html>
--- a/test/htmls/mixi-sensitive.html
+++ b/test/htmls/mixi-sensitive.html
@ -0,0 +1,13 @@
+<!doctype html>
+
+<html lang="en">
+	<head>
+		<meta charset="utf-8">
+		<meta property="mixi:content-rating" content="1">
+		<title>SENSITIVE CONTENT!!</title>
+	</head>
+	<body>
+		<h1>Yo</h1>
+		<p>Hey hey hey syuilo.</p>
+	</body>
+</html>
--- a/test/htmls/no-metas.html
+++ b/test/htmls/no-metas.html
@ -3,9 +3,10 @@
 <html lang="en">
 	<head>
 		<meta charset="utf-8">
+		<title>KISS principle</title>
 	</head>
 	<body>
 		<h1>KISS principle</h1>
-		<p>KISS is an acronym for "Keep it simple, stupid" as a design principle noted by the U.S. Navy in 1960.</p>
+		<p>KISS is an acronym for ”Keep it simple, stupid” as a design principle noted by the U.S. Navy in 1960.</p>
 	</body>
 </html>
--- a/test/htmls/oembed-and-og-video.html
+++ b/test/htmls/oembed-and-og-video.html
@ -0,0 +1,3 @@
+<!DOCTYPE html>
+<meta property="og:video:url" content="https://example.com/embedurl" />
+<link type="application/json+oembed" href="http://localhost:3060/oembed.json" />
--- a/test/htmls/oembed-and-og.html
+++ b/test/htmls/oembed-and-og.html
@ -0,0 +1,3 @@
+<!DOCTYPE html>
+<meta property="og:description" content="blobcats rule the world">
+<link type="application/json+oembed" href="http://localhost:3060/oembed.json" />
--- a/test/htmls/oembed-nonexistent-path.html
+++ b/test/htmls/oembed-nonexistent-path.html
@ -0,0 +1,3 @@
+<!DOCTYPE html>
+<link type="application/json+oembed" href="http://localhost:3060/oembe.json" />
+<meta property="og:description" content="nonexistent">
--- a/test/htmls/oembed-relative.html
+++ b/test/htmls/oembed-relative.html
@ -0,0 +1,2 @@
+<!DOCTYPE html>
+<link type="application/json+oembed" href="oembed.json" />
--- a/test/htmls/oembed-wrong-path.html
+++ b/test/htmls/oembed-wrong-path.html
@ -0,0 +1,3 @@
+<!DOCTYPE html>
+<link type="application/json+oembed" href="http://localhost:+3060/oembed.json" />
+<meta property="og:description" content="wrong url">
--- a/test/htmls/oembed.html
+++ b/test/htmls/oembed.html
@ -0,0 +1,2 @@
+<!DOCTYPE html>
+<link type="application/json+oembed" href="http://localhost:3060/oembed.json" />
--- a/test/index.ts
+++ b/test/index.ts
@ -6,13 +6,16 @@

 /* dependencies below */

-import fs from 'node:fs';
+import fs, { readdirSync } from 'node:fs';
 import process from 'node:process';
-import fastify from 'fastify';
-import { summaly } from '../src/index.js';
 import { dirname } from 'node:path';
 import { fileURLToPath } from 'node:url';
-import {expect, jest, test, describe, beforeEach, afterEach} from '@jest/globals';
+import { Agent as httpAgent } from 'node:http';
+import { Agent as httpsAgent } from 'node:https';
+import { expect, test, describe, beforeEach, afterEach } from '@jest/globals';
+import fastify from 'fastify';
+import { summaly } from '../src/index.js';
+import { StatusError } from '../src/utils/status-error.js';

 const _filename = fileURLToPath(import.meta.url);
 const _dirname = dirname(_filename);
@ -31,18 +34,86 @@ const host = `http://localhost:${port}`;
 // Display detail of unhandled promise rejection
 process.on('unhandledRejection', console.dir);

-let app: ReturnType<typeof fastify>;
+let app: ReturnType<typeof fastify> | null = null;

-afterEach(() => {
-	if (app) return app.close();
+afterEach(async () => {
+	if (app) {
+		await app.close();
+		app = null;
+	}
 });

 /* tests below */

+test('basic', async () => {
+	app = fastify();
+	app.get('/', (request, reply) => {
+		const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+		reply.header('content-length', content.length);
+		reply.header('content-type', 'text/html');
+		return reply.send(content);
+	});
+	await app.listen({ port });
+	expect(await summaly(host)).toEqual({
+		title: 'KISS principle',
+		icon: null,
+		description: null,
+		thumbnail: null,
+		player: {
+			url: null,
+			width: null,
+			height: null,
+			'allow': [
+				'autoplay',
+				'encrypted-media',
+				'fullscreen',
+			],
+		},
+		sitename: 'localhost:3060',
+		sensitive: false,
+		url: host,
+		activityPub: null,
+	});
+});
+
+test('Stage Bye Stage', async () => {
+	// If this test fails, you must rewrite the result data and the example in README.md.
+
+	const summary = await summaly('https://www.youtube.com/watch?v=NMIEAhH_fTU');
+	expect(summary).toEqual(
+		{
+			'title': '【アイドルマスター】「Stage Bye Stage」(歌：島村卯月、渋谷凛、本田未央)',
+			'icon': 'https://www.youtube.com/s/desktop/4feff1e2/img/favicon.ico',
+			'description': 'Website▶https://columbia.jp/idolmaster/Playlist▶https://www.youtube.com/playlist?list=PL83A2998CF3BBC86D2018年7月18日発売予定THE IDOLM@STER CINDERELLA GIRLS CG STAR...',
+			'thumbnail': 'https://i.ytimg.com/vi/NMIEAhH_fTU/maxresdefault.jpg',
+			'player': {
+				'url': 'https://www.youtube.com/embed/NMIEAhH_fTU?feature=oembed',
+				'width': 200,
+				'height': 113,
+				'allow': [
+					'autoplay',
+					'clipboard-write',
+					'encrypted-media',
+					'picture-in-picture',
+					'web-share',
+					'fullscreen',
+				],
+			},
+			'sitename': 'YouTube',
+			'sensitive': false,
+			'activityPub': null,
+			'url': 'https://www.youtube.com/watch?v=NMIEAhH_fTU',
+		},
+	);
+});
+
 test('faviconがHTML上で指定されていないが、ルートに存在する場合、正しく設定される', async () => {
 	app = fastify();
 	app.get('/', (request, reply) => {
-		return reply.send(fs.createReadStream(_dirname + '/htmls/no-favicon.html'));
+		const content = fs.readFileSync(_dirname + '/htmls/no-favicon.html');
+		reply.header('content-length', content.length);
+		reply.header('content-type', 'text/html');
+		return reply.send(content);
 	});
 	app.get('/favicon.ico', (_, reply) => reply.status(200).send());
 	await app.listen({ port });
@ -54,7 +125,10 @@ test('faviconがHTML上で指定されていないが、ルートに存在する
 test('faviconがHTML上で指定されていなくて、ルートにも存在しなかった場合 null になる', async () => {
 	app = fastify();
 	app.get('/', (request, reply) => {
-		return reply.send(fs.createReadStream(_dirname + '/htmls/no-favicon.html'));
+		const content = fs.readFileSync(_dirname + '/htmls/no-favicon.html');
+		reply.header('content-length', content.length);
+		reply.header('content-type', 'text/html');
+		return reply.send(content);
 	});
 	app.get('*', (_, reply) => reply.status(404).send());
 	await app.listen({ port });
@ -66,7 +140,10 @@ test('faviconがHTML上で指定されていなくて、ルートにも存在し
 test('titleがcleanupされる', async () => {
 	app = fastify();
 	app.get('/', (request, reply) => {
-		return reply.send(fs.createReadStream(_dirname + '/htmls/ditry-title.html'));
+		const content = fs.readFileSync(_dirname + '/htmls/og-title.html');
+		reply.header('content-length', content.length);
+		reply.header('content-type', 'text/html');
+		return reply.send(content);
 	});
 	await app.listen({ port });

@ -77,15 +154,42 @@ test('titleがcleanupされる', async () => {
 describe('Private IP blocking', () => {
 	beforeEach(() => {
 		process.env.SUMMALY_ALLOW_PRIVATE_IP = 'false';
+		app = fastify();
+		app.get('*', (request, reply) => {
+			const content = fs.readFileSync(_dirname + '/htmls/og-title.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		return app.listen({ port });
 	});

 	test('private ipなサーバーの情報を取得できない', async () => {
-		app = fastify();
-		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/og-title.html'));
+		const summary = await summaly(host).catch((e: StatusError) => e);
+		if (summary instanceof StatusError) {
+			expect(summary.name).toBe('StatusError');
+		} else {
+			expect(summary).toBeInstanceOf(StatusError);
+		}
+	});
+
+	test('agentが指定されている場合はprivate ipを許可', async () => {
+		const summary = await summaly(host, {
+			agent: {
+				http: new httpAgent({ keepAlive: true }),
+				https: new httpsAgent({ keepAlive: true }),
+			},
 		});
-		await app.listen({ port });
-		expect(() => summaly(host)).rejects.toMatch('Private IP rejected 127.0.0.1');
+		expect(summary.title).toBe('Strawberry Pasta');
+	});
+
+	test('agentが空のオブジェクトの場合はprivate ipを許可しない', async () => {
+		const summary = await summaly(host, { agent: {} }).catch((e: StatusError) => e);
+		if (summary instanceof StatusError) {
+			expect(summary.name).toBe('StatusError');
+		} else {
+			expect(summary).toBeInstanceOf(StatusError);
+		}
 	});

 	afterEach(() => {
@ -96,8 +200,11 @@ describe('Private IP blocking', () => {
 describe('OGP', () => {
 	test('title', async () => {
 		app = fastify();
-		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/og-title.html'));
+		app.get('*', (request, reply) => {
+			const content = fs.readFileSync(_dirname + '/htmls/og-title.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -108,7 +215,10 @@ describe('OGP', () => {
 	test('description', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/og-description.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/og-description.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -119,7 +229,10 @@ describe('OGP', () => {
 	test('site_name', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/og-site_name.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/og-site_name.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -130,7 +243,10 @@ describe('OGP', () => {
 	test('thumbnail', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/og-image.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/og-image.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -143,7 +259,10 @@ describe('TwitterCard', () => {
 	test('title', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/twitter-title.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/twitter-title.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -154,7 +273,10 @@ describe('TwitterCard', () => {
 	test('description', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/twitter-description.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/twitter-description.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -165,7 +287,10 @@ describe('TwitterCard', () => {
 	test('thumbnail', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/twitter-image.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/twitter-image.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -176,29 +301,40 @@ describe('TwitterCard', () => {
 	test('Player detection - PeerTube:video => video', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/player-peertube-video.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/player-peertube-video.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

 		const summary = await summaly(host);
 		expect(summary.player.url).toBe('https://example.com/embedurl');
+		expect(summary.player.allow).toStrictEqual(['autoplay', 'encrypted-media', 'fullscreen']);
 	});

 	test('Player detection - Pleroma:video => video', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/player-pleroma-video.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/player-pleroma-video.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

 		const summary = await summaly(host);
 		expect(summary.player.url).toBe('https://example.com/embedurl');
+		expect(summary.player.allow).toStrictEqual(['autoplay', 'encrypted-media', 'fullscreen']);
 	});

 	test('Player detection - Pleroma:image => image', async () => {
 		app = fastify();
 		app.get('/', (request, reply) => {
-			return reply.send(fs.createReadStream(_dirname + '/htmls/player-pleroma-image.html'));
+			const content = fs.readFileSync(_dirname + '/htmls/player-pleroma-image.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
 		});
 		await app.listen({ port });

@ -206,3 +342,296 @@ describe('TwitterCard', () => {
 		expect(summary.thumbnail).toBe('https://example.com/imageurl');
 	});
 });
+
+describe('oEmbed', () => {
+	const setUpFastify = async (oEmbedPath: string, htmlPath = 'htmls/oembed.html') => {
+		app = fastify();
+		app.get('/', (request, reply) => {
+			const content = fs.readFileSync(new URL(htmlPath, import.meta.url));
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		app.get('/oembed.json', (request, reply) => {
+			const content = fs.readFileSync(new URL(oEmbedPath, new URL('oembed/', import.meta.url)));
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'application/json');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+	};
+
+	for (const filename of readdirSync(new URL('oembed/invalid', import.meta.url))) {
+		test(`Invalidity test: ${filename}`, async () => {
+			await setUpFastify(`invalid/${filename}`);
+			const summary = await summaly(host);
+			expect(summary.player.url).toBe(null);
+		});
+	}
+
+	test('basic properties', async () => {
+		await setUpFastify('oembed.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.width).toBe(500);
+		expect(summary.player.height).toBe(300);
+	});
+
+	test('type: video', async () => {
+		await setUpFastify('oembed-video.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.width).toBe(500);
+		expect(summary.player.height).toBe(300);
+	});
+
+	test('max height', async () => {
+		await setUpFastify('oembed-too-tall.json');
+		const summary = await summaly(host);
+		expect(summary.player.height).toBe(1024);
+	});
+
+	test('children are ignored', async () => {
+		await setUpFastify('oembed-iframe-child.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+	});
+
+	test('allows fullscreen', async () => {
+		await setUpFastify('oembed-allow-fullscreen.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.allow).toStrictEqual(['fullscreen']);
+	});
+
+	test('allows legacy allowfullscreen', async () => {
+		await setUpFastify('oembed-allow-fullscreen-legacy.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.allow).toStrictEqual(['fullscreen']);
+	});
+
+	test('allows safelisted permissions', async () => {
+		await setUpFastify('oembed-allow-safelisted-permissions.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.allow).toStrictEqual([
+			'autoplay', 'clipboard-write', 'fullscreen',
+			'encrypted-media', 'picture-in-picture', 'web-share',
+		]);
+	});
+
+	test('ignores rare permissions', async () => {
+		await setUpFastify('oembed-ignore-rare-permissions.json');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.allow).toStrictEqual(['autoplay']);
+	});
+
+	test('oEmbed with relative path', async () => {
+		await setUpFastify('oembed.json', 'htmls/oembed-relative.html');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+	});
+
+	test('oEmbed with nonexistent path', async () => {
+		await setUpFastify('oembed.json', 'htmls/oembed-nonexistent-path.html');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe(null);
+		expect(summary.description).toBe('nonexistent');
+	});
+
+	test('oEmbed with wrong path', async () => {
+		await setUpFastify('oembed.json', 'htmls/oembed-wrong-path.html');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe(null);
+		expect(summary.description).toBe('wrong url');
+	});
+
+	test('oEmbed with OpenGraph', async () => {
+		await setUpFastify('oembed.json', 'htmls/oembed-and-og.html');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.description).toBe('blobcats rule the world');
+	});
+
+	test('Invalid oEmbed with valid OpenGraph', async () => {
+		await setUpFastify('invalid/oembed-insecure.json', 'htmls/oembed-and-og.html');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe(null);
+		expect(summary.description).toBe('blobcats rule the world');
+	});
+
+	test('oEmbed with og:video', async () => {
+		await setUpFastify('oembed.json', 'htmls/oembed-and-og-video.html');
+		const summary = await summaly(host);
+		expect(summary.player.url).toBe('https://example.com/');
+		expect(summary.player.allow).toStrictEqual([]);
+	});
+
+	test('width: 100%', async () => {
+		await setUpFastify('oembed-percentage-width.json');
+		const summary = await summaly(host);
+		expect(summary.player.width).toBe(null);
+		expect(summary.player.height).toBe(300);
+	});
+});
+
+describe('ActivityPub', () => {
+	test('Basic', async () => {
+		app = fastify();
+		app.get('*', (request, reply) => {
+			const content = fs.readFileSync(_dirname + '/htmls/activitypub.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+
+		const summary = await summaly(host);
+		expect(summary.activityPub).toBe('https://misskey.test/notes/abcdefg');
+	});
+
+	test('Null', async () => {
+		app = fastify();
+		app.get('*', (request, reply) => {
+			const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+
+		const summary = await summaly(host);
+		expect(summary.activityPub).toBe(null);
+	});
+});
+
+describe('sensitive', () => {
+	test('default', async () => {
+		app = fastify();
+		app.get('/', (request, reply) => {
+			const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+		expect((await summaly(host)).sensitive).toBe(false);
+	});
+
+	test('mixi:content-rating 1', async () => {
+		app = fastify();
+		app.get('/', (request, reply) => {
+			const content = fs.readFileSync(_dirname + '/htmls/mixi-sensitive.html');
+			reply.header('content-length', content.length);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+		expect((await summaly(host)).sensitive).toBe(true);
+	});
+});
+
+describe('UserAgent', () => {
+	test('UA設定が反映されていること', async () => {
+		const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+		let ua: string | undefined = undefined;
+
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-length', content.byteLength);
+			reply.header('content-type', 'text/html');
+			ua = request.headers['user-agent'];
+			return reply.send(content);
+		});
+		await app.listen({ port });
+		await summaly(host, { userAgent: 'test-ua' });
+
+		expect(ua).toBe('test-ua');
+	});
+});
+
+describe('content-length limit', () => {
+	test('content-lengthの上限以内であればエラーが起こらないこと', async () => {
+		const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-length', content.byteLength);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+
+		expect(await summaly(host, { contentLengthLimit: content.byteLength })).toBeDefined();
+	});
+
+	test('content-lengthの上限を超えているとエラーになる事', async () => {
+		const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-length', content.byteLength);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+
+		await expect(summaly(host, { contentLengthLimit: content.byteLength - 1 })).rejects.toThrow();
+	});
+});
+
+describe('content-length required', () => {
+	test('[オプション有効化時] content-lengthが返された場合はエラーとならないこと', async () => {
+		const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-length', content.byteLength);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+
+		expect(await summaly(host, { contentLengthRequired: true, contentLengthLimit: content.byteLength })).toBeDefined();
+	});
+
+	test('[オプション有効化時] content-lengthが返されない場合はエラーとなること', async () => {
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-type', 'text/html');
+			// streamで渡さないとcontent-lengthを自動で設定されてしまう
+			return reply.send(fs.createReadStream(_dirname + '/htmls/basic.html'));
+		});
+		await app.listen({ port });
+
+		await expect(summaly(host, { contentLengthRequired: true })).rejects.toThrow();
+	});
+
+	test('[オプション無効化時] content-lengthが返された場合はエラーとならないこと', async () => {
+		const content = fs.readFileSync(_dirname + '/htmls/basic.html');
+
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-length', content.byteLength);
+			reply.header('content-type', 'text/html');
+			return reply.send(content);
+		});
+		await app.listen({ port });
+
+		expect(await summaly(host, { contentLengthRequired: false, contentLengthLimit: content.byteLength })).toBeDefined();
+	});
+
+	test('[オプション無効化時] content-lengthが返されなくてもエラーとならないこと', async () => {
+		app = fastify();
+		app.get('/', (request, reply) => {
+			reply.header('content-type', 'text/html');
+			// streamで渡さないとcontent-lengthを自動で設定されてしまう
+			return reply.send(fs.createReadStream(_dirname + '/htmls/basic.html'));
+		});
+		await app.listen({ port });
+
+		expect(await summaly(host, { contentLengthRequired: false })).toBeDefined();
+	});
+});
--- a/test/oembed/invalid/oembed-child-iframe.json
+++ b/test/oembed/invalid/oembed-child-iframe.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<div><iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-double-iframes.json
+++ b/test/oembed/invalid/oembed-double-iframes.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe><iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-future.json
+++ b/test/oembed/invalid/oembed-future.json
@ -0,0 +1,7 @@
+{
+  "version": "11.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-insecure.json
+++ b/test/oembed/invalid/oembed-insecure.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='http://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-invalid-height.json
+++ b/test/oembed/invalid/oembed-invalid-height.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": "blobcat"
+}
--- a/test/oembed/invalid/oembed-no-height.json
+++ b/test/oembed/invalid/oembed-no-height.json
@ -0,0 +1,6 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500
+}
--- a/test/oembed/invalid/oembed-no-version.json
+++ b/test/oembed/invalid/oembed-no-version.json
@ -0,0 +1,6 @@
+{
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-old.json
+++ b/test/oembed/invalid/oembed-old.json
@ -0,0 +1,7 @@
+{
+  "version": "0.1",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-photo.json
+++ b/test/oembed/invalid/oembed-photo.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "photo",
+  "url": "https://example.com/example.avif",
+  "width": 300,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-too-powerful.json
+++ b/test/oembed/invalid/oembed-too-powerful.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/' allow='camera'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/invalid/oembed-too-powerful2.json
+++ b/test/oembed/invalid/oembed-too-powerful2.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/' allow='fullscreen;camera'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed-allow-fullscreen-legacy.json
+++ b/test/oembed/oembed-allow-fullscreen-legacy.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/' allowfullscreen></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed-allow-fullscreen.json
+++ b/test/oembed/oembed-allow-fullscreen.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/' allow='fullscreen'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed-allow-safelisted-permissions.json
+++ b/test/oembed/oembed-allow-safelisted-permissions.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/' allow='autoplay;clipboard-write;fullscreen;encrypted-media;picture-in-picture;web-share'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed-iframe-child.json
+++ b/test/oembed/oembed-iframe-child.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'><script>alert('Hahaha I take this world')</script></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed-ignore-rare-permissions.json
+++ b/test/oembed/oembed-ignore-rare-permissions.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/' allow='autoplay;gyroscope;accelerometer'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed-percentage-width.json
+++ b/test/oembed/oembed-percentage-width.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": "100%",
+  "height": 300
+}
--- a/test/oembed/oembed-too-tall.json
+++ b/test/oembed/oembed-too-tall.json
@ -0,0 +1,6 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "height": 3000
+}
--- a/test/oembed/oembed-video.json
+++ b/test/oembed/oembed-video.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "video",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/oembed/oembed.json
+++ b/test/oembed/oembed.json
@ -0,0 +1,7 @@
+{
+  "version": "1.0",
+  "type": "rich",
+  "html": "<iframe src='https://example.com/'></iframe>",
+  "width": 500,
+  "height": 300
+}
--- a/test/tsconfig.json
+++ b/test/tsconfig.json
@ -0,0 +1,6 @@
+{
+	"extends": "../tsconfig.json",
+	"include": [
+		"./**/*.ts"
+	],
+}
--- a/tslint.json
+++ b/tslint.json
@ -1,86 +0,0 @@
-{
-	"rules": {
-		"align": [true,
-			"parameters",
-			"statements"
-		],
-		"ban": false,
-		"class-name": true,
-		"comment-format": [true,
-			"check-upper-case"
-		],
-		"curly": true,
-		"eofline": true,
-		"forin": false,
-		"indent": [true, "tabs"],
-		"interface-name": false,
-		"jsdoc-format": true,
-		"label-position": true,
-		"label-undefined": true,
-		"max-line-length": false,
-		"member-access": false,
-		"member-ordering": [true,
-			"static-before-instance",
-			"variables-before-functions"
-		],
-		"no-any": false,
-		"no-arg": true,
-		"no-bitwise": true,
-		"no-console": [true,
-			"debug",
-			"info",
-			"time",
-			"timeEnd",
-			"trace"
-		],
-		"no-consecutive-blank-lines": true,
-		"no-construct": true,
-		"no-constructor-vars": true,
-		"no-debugger": true,
-		"no-duplicate-key": true,
-		"no-shadowed-variable": false,
-		"no-duplicate-variable": true,
-		"no-empty": true,
-		"no-eval": true,
-		"no-internal-module": true,
-		"no-require-imports": false,
-		"no-string-literal": false,
-		"no-switch-case-fall-through": true,
-		"no-trailing-whitespace": true,
-		"no-unreachable": true,
-		"no-unused-expression": true,
-		"no-unused-variable": true,
-		"no-use-before-declare": true,
-		"no-var-keyword": true,
-		"no-var-requires": false,
-		"one-line": [true,
-			"check-catch",
-			"check-whitespace"
-		],
-		"quotemark": false,
-		"radix": true,
-		"semicolon": true,
-		"switch-default": false,
-		"triple-equals": false,
-		"typedef": [true,
-			"call-signature",
-			"property-declaration"
-		],
-		"typedef-whitespace": [true, {
-			"call-signature": "nospace",
-			"index-signature": "nospace",
-			"parameter": "nospace",
-			"property-declaration": "nospace",
-			"variable-declaration": "nospace"
-		}],
-		"use-strict": false,
-		"variable-name": false,
-		"whitespace": [true,
-			"check-branch",
-			"check-decl",
-			"check-operator",
-			"check-separator",
-			"check-type"
-		]
-	}
-}
Author	SHA1	Message	Date
おさむのひと	509a35abe2	Update CHANGELOG.md	2024-03-18 19:40:04 +09:00
おさむのひと	79d9eadd58	fix: 次バージョンに向けての記載を追加 (#25 )	2024-03-18 10:51:35 +09:00
おさむのひと	c261071a82	fix: サマリ取得の動作改善＋動作設定を可能にする (#23 )	2024-03-17 16:53:32 +09:00
tamaina	71fe234d3e	chore: improve lint	2023-12-30 16:28:45 +00:00
tamaina	718465e498	5.0.3	2023-12-30 10:26:31 +00:00
tamaina	77c53be159	v5.0.2	2023-12-30 09:22:39 +00:00
tamaina	541a0ddd0a	fix workflow (v5.0.1)	2023-12-30 09:09:13 +00:00
tamaina	7e94c26e9f	fix workflow name	2023-12-30 08:37:41 +00:00
tamaina	2f5ab74f52	v5.0.0	2023-12-30 08:36:45 +00:00
tamaina	7902ded327	なんかめっちゃ変えた	2023-12-30 08:36:01 +00:00
tamaina	67909d360d	npm install @misskey-dev/summaly	2023-12-30 07:14:54 +00:00
tamaina	0606cd3fae	Update workflow to change name to Test	2023-12-30 07:04:46 +00:00
tamaina	52f5692199	update typescript	2023-12-30 07:03:53 +00:00
tamaina	3ecb30aefc	ignore built, remove travis.yml	2023-12-30 06:59:59 +00:00
tamaina	c45b3a1c63	add workflows, mod chglog, remove built	2023-12-30 06:53:31 +00:00
tamaina	81de408b54	remove package-lock.json https://github.com/misskey-dev/summaly/issues/18	2023-12-30 06:42:33 +00:00
anatawa12	38000dd462	feat: support 'mixi:content-rating' for sensitive (#16 ) * feat: support 'mixi:content-rating' for sensitive * fix: `d7f6a88aee` でビルドしてない * ビルドする	2023-12-30 15:33:43 +09:00
anatawa12	d7f6a88aee	fix: twitter card with name attr not working (#15 )	2023-12-02 21:05:33 +09:00
かっこかり	d2a3e07205	fix: branch.ioを用いたディープリンクをパースできるように修正 (#13 ) * (fix) branch.ioのディープリンクでうまく作動しないのを修正 * Update changelog * fix regex	2023-11-15 19:23:03 +09:00
Kagami Sascha Rosylight	d2d8db4994	fix: use `activity+json` instead of `activitypub+json` (#11 )	2023-08-06 19:30:20 +02:00
Kagami Sascha Rosylight	089a0ad8e8	feat: support `<link rel=alternate type=application/activitypub+json>` (#10 ) * feat: support `<link rel=alternate type=application/activitypub+json>` * Update index.ts * build	2023-07-20 15:36:26 +09:00
tamaina	77dd5654bb	README.md	2023-05-07 12:19:50 +00:00
tamaina	2d63e2a006	fix README.md	2023-05-04 17:18:10 +00:00
tamaina	c7d71a9ec2	Merge branch 'master' of https://github.com/misskey-dev/summaly	2023-04-20 04:02:59 +00:00
tamaina	994f420b46	4.0.2	2023-04-20 04:02:55 +00:00
Kagami Sascha Rosylight	5a3321a04f	fix: allow legacy `allowfullscreen` (#9 )	2023-04-20 12:41:11 +09:00
tamaina	1bab7afee6	Merge branch 'master' of https://github.com/misskey-dev/summaly	2023-03-16 03:26:10 +00:00
tamaina	441e8c22f9	v4.0.1	2023-03-16 03:26:00 +00:00
Kagami Sascha Rosylight	376bba9c61	fix: give null when oEmbed access fails (#8 )	2023-03-16 12:22:23 +09:00
tamaina	028b2fed2f	fix README.md	2023-03-13 18:03:16 +00:00
tamaina	90d5d0f33b	Fix README.md	2023-03-13 18:02:07 +00:00
tamaina	9e955d8d04	fix readme	2023-03-13 17:57:37 +00:00
tamaina	a36652c859	v4.0.0	2023-03-13 17:53:29 +00:00
Kagami Sascha Rosylight	eab3766db9	feat: add oEmbed support (#6 ) * feat: add oEmbed support * more safelisted features * fix the syntax * Update README.md * permissions * names * playerを使うように * fix type error * support width (for size ratio) * test for type: video * nullable width * restore max height test * ignored permissions * restore autoplay * Use WHATWG URL --------- Co-authored-by: tamaina <tamaina@hotmail.co.jp>	2023-03-14 02:46:41 +09:00
tamaina	51f3870e1f	fix changelog	2023-02-12 15:02:56 +00:00
tamaina	5684f116c9	v3.0.4	2023-02-12 14:44:43 +00:00
tamaina	709ca51b6c	v3.0.3	2023-02-12 14:37:37 +00:00
tamaina	f4a180907c	3.0.2	2023-02-12 12:29:17 +00:00
tamaina	3c7c3c8aa7	3.0.1	2023-02-12 12:20:38 +00:00
tamaina	199b247e85	3.0.1	2023-02-12 12:20:19 +00:00