SEO - 加入 robots.txt, sitemap, prerender 讓搜尋引擎可以獲取網頁資訊 #589
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
加入 robots.txt 與 sitemap 以幫助搜尋引擎爬網站 由於內容的網址必須動態產生，因此 robots.txt 不能使用單純的靜態檔案提供 sitemap針對公司網址會依照公司評級指定優先度，評級高的公司會有較高的優先度推薦搜尋引擎抓取 (抓取順序不影響搜尋結果排序)
使用 prerender 來讓搜尋引擎的BOT可以抓到完整的頁面 當收到BOT的訪問請求時，會轉由 prerender server 代為訪問網站，並將完整的結果傳回去 prerender server 會監聽的port可以在config中修改
設定3秒的等待時間，讓網頁能跑完整，也避免過於快速的做下一次請求造成伺服器負擔
增加更多不希望搜尋引擎去爬的頁面
在 production 設定為 true 的情況下才會開啟 prerender server
|
NOTE: 在這次的config檔變更中， |
This pull request was closed.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
meteor npm installGoogle Chrome加入
robots.txt，讓bot可以讀取，以得知哪些網址我們不建議掃描，還有建議掃描的sitemap在哪加入
sitemap，提供公司網址網址會依照公司評級指定優先度，評級高的公司會有較高的優先度推薦搜尋引擎抓取 (抓取順序不影響搜尋結果排序)
使用
prerender來讓搜尋引擎的BOT可以抓到完整的頁面當收到BOT的訪問請求時，會轉由
prerender server代為訪問網站，並將完整的結果傳回去prerender server監聽的port可以在config中修改，目前port設定為3900由於會開
prerender server，需要在伺服器安裝Google Chrome可以用這條指令直接安裝
wget -qO- https://github.com/raw/SoftwareSing/linux-install/master/install-chrome.sh | bash安裝後建議重新啟動