Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
code4craft
/
webmagic
Public
Notifications
You must be signed in to change notification settings
Fork
4.1k
Star
11.7k
Code
Issues
337
Pull requests
30
Actions
Projects
Wiki
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Wiki
Security and quality
Insights
Commits
Breadcrumbs
History for
webmagic
webmagic-core
src
on
develop
User selector
All users
All time
Commit history
Commits on Dec 22, 2024
Remove useless modifier.
sutra
committed
42a1727
View commit details
Copy full SHA for 42a1727
View code at this point
Browse repository at this point
Commits on Dec 11, 2024
修改SmartContentSelector threshold可定制化 (#1183)
Show description for 9bb2417
zyw61483
and
zhaoyiwei
authored
9bb2417
View commit details
Copy full SHA for 9bb2417
View code at this point
Browse repository at this point
Commits on Nov 26, 2024
Polish code.
sutra
committed
c20edb8
View commit details
Copy full SHA for c20edb8
View code at this point
Browse repository at this point
Add static methods to construct Page.
sutra
committed
0a9fe8d
View commit details
Copy full SHA for 0a9fe8d
View code at this point
Browse repository at this point
Commits on Oct 9, 2024
Change the default status code from 200 to 0 & downloadSuccess from true to false, for Page.
sutra
committed
541ced9
View commit details
Copy full SHA for 541ced9
View code at this point
Browse repository at this point
Commits on Aug 19, 2024
FileCacheQueueScheduler使用BloomFilter进行去重 (#1176)
Show description for 15ec80f
blanexie
and
xiezhicheng02
authored
15ec80f
View commit details
Copy full SHA for 15ec80f
View code at this point
Browse repository at this point
Commits on Aug 6, 2024
#1172 问题的解决 (#1173)
Show description for 2c135da
blanexie
and
xiezhicheng
authored
2c135da
View commit details
Copy full SHA for 2c135da
View code at this point
Browse repository at this point
Commits on Jun 17, 2024
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Show description for 4d0cdb0
niuxiaozu
and
niuxiaozu
authored
4d0cdb0
View commit details
Copy full SHA for 4d0cdb0
View code at this point
Browse repository at this point
Commits on Jun 3, 2024
Add a private constructor to hide the implicit public one.
sutra
committed
49a5eff
View commit details
Copy full SHA for 49a5eff
View code at this point
Browse repository at this point
Make sure the contentType of detectCharset could be null.
sutra
committed
5c43e36
View commit details
Copy full SHA for 5c43e36
View code at this point
Browse repository at this point
Make getCharset to support null parameter.
sutra
committed
d2aebc6
View commit details
Copy full SHA for d2aebc6
View code at this point
Browse repository at this point
Commits on Apr 23, 2024
Merge tag 'WebMagic-0.10.3' into develop
Show description for 4ee30c0
sutra
committed
4ee30c0
View commit details
Copy full SHA for 4ee30c0
View code at this point
Browse repository at this point
Fix for entity is null.
sutra
committed
462c60f
View commit details
Copy full SHA for 462c60f
View code at this point
Browse repository at this point
Merge tag 'WebMagic-0.10.2' into develop
Show description for 6be02f3
sutra
committed
6be02f3
View commit details
Copy full SHA for 6be02f3
View code at this point
Browse repository at this point
Remove useless log.
sutra
committed
0dbfaf7
View commit details
Copy full SHA for 0dbfaf7
View code at this point
Browse repository at this point
Merge tag 'WebMagic-0.10.1' into develop
Show description for 2217b1c
sutra
committed
2217b1c
View commit details
Copy full SHA for 2217b1c
View code at this point
Browse repository at this point
Fix NPE.
sutra
committed
78740a4
View commit details
Copy full SHA for 78740a4
View code at this point
Browse repository at this point
Fix log message.
sutra
committed
a0ff4a2
View commit details
Copy full SHA for a0ff4a2
View code at this point
Browse repository at this point
Commits on Apr 21, 2024
Remove public modifiers from junit5 test methods.
sutra
committed
9ab342c
View commit details
Copy full SHA for 9ab342c
View code at this point
Browse repository at this point
Add tests to test the equals & hashCode of Proxy.
sutra
committed
dba1668
View commit details
Copy full SHA for dba1668
View code at this point
Browse repository at this point
Commits on Apr 3, 2024
Replace log4j 1.x with log4j 2.x, refs #534.
sutra
committed
4ebf48f
View commit details
Copy full SHA for 4ebf48f
View code at this point
Browse repository at this point
Commits on Mar 30, 2024
Revert "Refactored code for increased optimization. (#1139)" (#1153)
Show description for 31548de
sutra
authored
31548de
View commit details
Copy full SHA for 31548de
View code at this point
Browse repository at this point
Refactored code for increased optimization. (#1139)
Show description for f051d97
Parthgajera056
authored
f051d97
View commit details
Copy full SHA for f051d97
View code at this point
Browse repository at this point
Refactored Code to increase maintainability (#1152)
Show description for 9b9f173
ayushi250317
authored
9b9f173
View commit details
Copy full SHA for 9b9f173
View code at this point
Browse repository at this point
Commits on Mar 28, 2024
Refactored Code to Resolve Implementation Code Smells (#1151)
Show description for 28ac8bf
ayushi250317
authored
28ac8bf
View commit details
Copy full SHA for 28ac8bf
View code at this point
Browse repository at this point
Commits on Mar 23, 2024
Added test cases for improving line and branch coverage (#1150)
Show description for 80842d7
ayushi250317
authored
80842d7
View commit details
Copy full SHA for 80842d7
View code at this point
Browse repository at this point
Commits on Mar 3, 2024
Optimize Request#extras, fix #1148.
sutra
committed
95d1f44
View commit details
Copy full SHA for 95d1f44
View code at this point
Browse repository at this point
Commits on Dec 5, 2023
Fix javadoc.
sutra
committed
7ededbe
View commit details
Copy full SHA for 7ededbe
View code at this point
Browse repository at this point
Commits on Nov 26, 2023
Refactor addTargetRequests method to eliminate redundant code. (#1138)
harikrishna553
authored
7c20290
View commit details
Copy full SHA for 7c20290
View code at this point
Browse repository at this point
Commits on Nov 24, 2023
Refactored to remove multiple calls of getSourceTexts() api (#1137)
harikrishna553
authored
a911104
View commit details
Copy full SHA for a911104
View code at this point
Browse repository at this point
Refactor compareLong method using Long.compare, corrected the local variable name (#1136)
harikrishna553
authored
622ed5a
View commit details
Copy full SHA for 622ed5a
View code at this point
Browse repository at this point
Commits on Nov 20, 2023
Expose Page to onSuccess & onError.
sutra
committed
67644de
View commit details
Copy full SHA for 67644de
View code at this point
Browse repository at this point
Commits on Nov 6, 2023
Fix log format.
sutra
committed
eda3be9
View commit details
Copy full SHA for eda3be9
View code at this point
Browse repository at this point
Commits on Jun 22, 2023
Fix test.
sutra
committed
ad01092
View commit details
Copy full SHA for ad01092
View code at this point
Browse repository at this point
Expose Request to ProxyProvider.
sutra
committed
58fd08b
View commit details
Copy full SHA for 58fd08b
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.