The htmlLimitedBots config allows you to specify a list of user agents that should receive blocking metadata instead of streaming metadata.
import type { NextConfig } from 'next'
const config: NextConfig = {
htmlLimitedBots: /MySpecialBot|MyAnotherSpecialBot|SimpleCrawler/,
}
export default configmodule.exports = {
htmlLimitedBots: /MySpecialBot|MyAnotherSpecialBot|SimpleCrawler/,
}Next.js includes a default list of HTML limited bots, including:
See the full list here.
Specifying a htmlLimitedBots config will override the Next.js' default list. However, this is advanced behavior, and the default should be sufficient for most cases.
const config: NextConfig = {
htmlLimitedBots: /MySpecialBot|MyAnotherSpecialBot|SimpleCrawler/,
}
export default configmodule.exports = {
htmlLimitedBots: /MySpecialBot|MyAnotherSpecialBot|SimpleCrawler/,
}To fully disable streaming metadata:
import type { NextConfig } from 'next'
const config: NextConfig = {
htmlLimitedBots: /.*/,
}
export default configmodule.exports = {
htmlLimitedBots: /.*/,
}| Version | Changes |
|---|---|
| 15.2.0 | htmlLimitedBots option introduced. |