https://sourceforge.net/p/j-spider/activity/Recent activity for JSpiderenMon, 21 Feb 2022 06:03:20 -0000https://sourceforge.net/p/j-spider/feature-requests/14/Logging revisionsEJPMon, 21 Feb 2022 06:03:20 -0000https://sourceforge.net/p/j-spider/feature-requests/14/https://sourceforge.net/p/j-spider/feature-requests/8/Sitemap plugin improvementsEJPMon, 21 Feb 2022 05:28:37 -0000https://sourceforge.net/p/j-spider/feature-requests/8/https://sourceforge.net/p/j-spider/feature-requests/15/Rationalize Rules subsystemEJPMon, 21 Feb 2022 05:27:48 -0000https://sourceforge.net/p/j-spider/feature-requests/15/https://sourceforge.net/p/j-spider/feature-requests/17/Sitemap parserEJPMon, 21 Feb 2022 05:27:21 -0000https://sourceforge.net/p/j-spider/feature-requests/17/https://sourceforge.net/p/j-spider/feature-requests/9/Set If-Modified-Since header and observe 304 statusEJPMon, 21 Feb 2022 05:25:33 -0000https://sourceforge.net/p/j-spider/feature-requests/9/https://sourceforge.net/p/j-spider/feature-requests/10/Use HEAD request when spidering: only fetch content if actually requiredEJPMon, 21 Feb 2022 05:25:03 -0000https://sourceforge.net/p/j-spider/feature-requests/10/https://sourceforge.net/p/j-spider/feature-requests/11/Rewrite cookie handling to use JDK facilitiesEJPMon, 21 Feb 2022 05:24:32 -0000https://sourceforge.net/p/j-spider/feature-requests/11/https://sourceforge.net/p/j-spider/feature-requests/12/Rewrite authentication to use standard JDK facilitiesEJPMon, 21 Feb 2022 05:24:06 -0000https://sourceforge.net/p/j-spider/feature-requests/12/https://sourceforge.net/p/j-spider/feature-requests/13/Rewrite proxying to use standard JDK facilitiesEJPMon, 21 Feb 2022 05:23:16 -0000https://sourceforge.net/p/j-spider/feature-requests/13/https://sourceforge.net/p/j-spider/feature-requests/14/Logging revisionsEJPMon, 21 Feb 2022 05:22:48 -0000https://sourceforge.net/p/j-spider/feature-requests/14/https://sourceforge.net/p/j-spider/feature-requests/16/Use 'default' configuration as the default for all other general configurationsEJPMon, 21 Feb 2022 05:22:11 -0000https://sourceforge.net/p/j-spider/feature-requests/16/https://sourceforge.net/p/j-spider/feature-requests/18/Accept Content-Encoding: gzip, deflateEJPMon, 21 Feb 2022 05:21:36 -0000https://sourceforge.net/p/j-spider/feature-requests/18/https://sourceforge.net/p/j-spider/feature-requests/18/Accept Content-Encoding: gzip, deflateEJPWed, 06 Oct 2021 03:32:46 -0000https://sourceforge.net/p/j-spider/feature-requests/18/https://sourceforge.net/p/j-spider/feature-requests/1/Lucene Plug-InEJPWed, 06 Oct 2021 03:29:24 -0000https://sourceforge.net/p/j-spider/feature-requests/1/https://sourceforge.net/p/j-spider/feature-requests/9/Set If-Modified-Since header and observe 304 statusEJPWed, 06 Oct 2021 03:28:55 -0000https://sourceforge.net/p/j-spider/feature-requests/9/https://sourceforge.net/p/j-spider/feature-requests/10/Use HEAD request when spidering: only fetch content if actually requiredEJPWed, 06 Oct 2021 03:28:33 -0000https://sourceforge.net/p/j-spider/feature-requests/10/https://sourceforge.net/p/j-spider/feature-requests/11/Rewrite cookie handling to use JDK facilitiesEJPWed, 06 Oct 2021 03:28:13 -0000https://sourceforge.net/p/j-spider/feature-requests/11/https://sourceforge.net/p/j-spider/feature-requests/11/Rewrite cookie handling to use JDK facilitiesEJPWed, 06 Oct 2021 03:27:52 -0000https://sourceforge.net/p/j-spider/feature-requests/11/https://sourceforge.net/p/j-spider/feature-requests/12/Rewrite authentication to use standard JDK facilitiesEJPWed, 06 Oct 2021 03:27:24 -0000https://sourceforge.net/p/j-spider/feature-requests/12/https://sourceforge.net/p/j-spider/feature-requests/13/Rewrite proxying to use standard JDK facilitiesEJPWed, 06 Oct 2021 03:27:01 -0000https://sourceforge.net/p/j-spider/feature-requests/13/https://sourceforge.net/p/j-spider/feature-requests/14/Logging revisionsEJPWed, 06 Oct 2021 03:26:36 -0000https://sourceforge.net/p/j-spider/feature-requests/14/https://sourceforge.net/p/j-spider/feature-requests/15/Rationalize Rules subsystemEJPWed, 06 Oct 2021 03:26:13 -0000https://sourceforge.net/p/j-spider/feature-requests/15/https://sourceforge.net/p/j-spider/feature-requests/16/Use 'default' configuration as the default for all other general configurationsEJPWed, 06 Oct 2021 03:25:26 -0000https://sourceforge.net/p/j-spider/feature-requests/16/https://sourceforge.net/p/j-spider/feature-requests/17/Sitemap parserEJPWed, 06 Oct 2021 03:24:48 -0000https://sourceforge.net/p/j-spider/feature-requests/17/https://sourceforge.net/p/j-spider/feature-requests/8/Sitemap plugin improvementsEJPTue, 21 Sep 2021 06:33:04 -0000https://sourceforge.net/p/j-spider/feature-requests/8/https://sourceforge.net/p/j-spider/feature-requests/16/Use 'default' configuration as the default for all other general configurationsEJPMon, 20 Sep 2021 07:56:12 -0000https://sourceforge.net/p/j-spider/feature-requests/16/https://sourceforge.net/p/j-spider/feature-requests/15/Rationalize Rules subsystemEJPMon, 20 Sep 2021 07:53:54 -0000https://sourceforge.net/p/j-spider/feature-requests/15/https://sourceforge.net/p/j-spider/feature-requests/14/Logging revisionsEJPMon, 20 Sep 2021 07:43:51 -0000https://sourceforge.net/p/j-spider/feature-requests/14/https://sourceforge.net/p/j-spider/feature-requests/13/Rewrite proxying to use standard JDK facilitiesEJPMon, 20 Sep 2021 07:39:32 -0000https://sourceforge.net/p/j-spider/feature-requests/13/https://sourceforge.net/p/j-spider/feature-requests/12/Rewrite authentication to use standard JDK facilitiesEJPMon, 20 Sep 2021 07:38:18 -0000https://sourceforge.net/p/j-spider/feature-requests/12/https://sourceforge.net/p/j-spider/feature-requests/11/Rewrite cookie handling to use JDK facilitiesEJPMon, 20 Sep 2021 07:36:37 -0000https://sourceforge.net/p/j-spider/feature-requests/11/https://sourceforge.net/p/j-spider/feature-requests/10/Use HEAD request when spidering: only fetch content if actually requiredEJPMon, 20 Sep 2021 07:32:36 -0000https://sourceforge.net/p/j-spider/feature-requests/10/https://sourceforge.net/p/j-spider/feature-requests/9/Set If-Modified-Since header and observe 304 statusEJPMon, 20 Sep 2021 07:31:17 -0000https://sourceforge.net/p/j-spider/feature-requests/9/https://sourceforge.net/p/j-spider/feature-requests/8/Sitemap plugin improvementsEJPMon, 20 Sep 2021 07:29:06 -0000https://sourceforge.net/p/j-spider/feature-requests/8/https://sourceforge.net/p/j-spider/feature-requests/7/?limit=25#102eDeleted this code again in favour of using a java.net.Authenticator as God intended.EJPMon, 09 Aug 2021 08:16:57 -0000https://sourceforge.net/p/j-spider/feature-requests/7/?limit=25#102ehttps://sourceforge.net/p/j-spider/feature-requests/1/Lucene Plug-InEJPMon, 09 Aug 2021 08:14:25 -0000https://sourceforge.net/p/j-spider/feature-requests/1/https://sourceforge.net/p/j-spider/feature-requests/1/?limit=25#e7a3Accepted for upcoming 1.0 release. Configurability remains an issue, mainly of Analyzers. I presently have it that you can name your own class if it just needs no-args construction, default StandardAnalyzer, and if you need to use a more complex one you override a getAnalyzer() method. Not sure what else can be done. It's a long time since I used Lucene and they keep changing the API, which doesn't help. Also it introduces a dependency on SLF4J grrr.EJPMon, 09 Aug 2021 08:14:25 -0000https://sourceforge.net/p/j-spider/feature-requests/1/?limit=25#e7a3https://sourceforge.net/p/j-spider/discussion/222310/thread/e5606461/?limit=25#14d8All this is being addressed in the upcoming 1.0 release.EJPTue, 27 Jul 2021 23:52:37 -0000https://sourceforge.net/p/j-spider/discussion/222310/thread/e5606461/?limit=25#14d8https://sourceforge.net/p/j-spider/discussion/222309/thread/169aeb74/?limit=25#935fAnthony, I am preparing a 1.0 release to appear in the coming weeks. Many improvements. I plan to support this as long as I can, and to leave it in a clean state for when I can't. EJPEJPTue, 27 Jul 2021 23:44:51 -0000https://sourceforge.net/p/j-spider/discussion/222309/thread/169aeb74/?limit=25#935fhttps://sourceforge.net/p/j-spider/feature-requests/1/Lucene Plug-InEJPTue, 27 Jul 2021 00:16:12 -0000https://sourceforge.net/p/j-spider/feature-requests/1/https://sourceforge.net/p/j-spider/feature-requests/5/?limit=25#214aFixed in upcoming 1.0 release.EJPTue, 27 Jul 2021 00:14:35 -0000https://sourceforge.net/p/j-spider/feature-requests/5/?limit=25#214ahttps://sourceforge.net/p/j-spider/feature-requests/5/jSpider reusability.EJPTue, 27 Jul 2021 00:14:35 -0000https://sourceforge.net/p/j-spider/feature-requests/5/https://sourceforge.net/p/j-spider/bugs/28/Events not visitedEJPSat, 17 Jul 2021 00:58:56 -0000https://sourceforge.net/p/j-spider/bugs/28/https://sourceforge.net/p/j-spider/bugs/24/no favicon.ico supportEJPSat, 17 Jul 2021 00:57:09 -0000https://sourceforge.net/p/j-spider/bugs/24/https://sourceforge.net/p/j-spider/bugs/4/String index out of range: -1EJPSat, 17 Jul 2021 00:34:40 -0000https://sourceforge.net/p/j-spider/bugs/4/https://sourceforge.net/p/j-spider/feature-requests/6/Spider CSS and JS filesEJPSat, 17 Jul 2021 00:33:34 -0000https://sourceforge.net/p/j-spider/feature-requests/6/https://sourceforge.net/p/j-spider/feature-requests/6/?limit=25#5e7dGood idea. A CSS parser and a more flexible mime-type system have been added to the upcoming 1.0 release.EJPSat, 17 Jul 2021 00:33:34 -0000https://sourceforge.net/p/j-spider/feature-requests/6/?limit=25#5e7dhttps://sourceforge.net/p/j-spider/feature-requests/3/Make Caching site specific propertyEJPThu, 15 Jul 2021 02:06:42 -0000https://sourceforge.net/p/j-spider/feature-requests/3/https://sourceforge.net/p/j-spider/feature-requests/3/?limit=25#7e51This patch also requires adding the following to SpiderContextImpl.registerNewSite(), after all the other 'sitei' configurations: sitei.setCacheControl(siteProps.getString(ConfigConstants.SITE_CACHE_CONTROL, Constants.CACHE_CONTROL)); sitei.setUseCache(siteProps.getBoolean(ConfigConstants.SITE_CACHE_USE, false));EJPThu, 15 Jul 2021 02:06:42 -0000https://sourceforge.net/p/j-spider/feature-requests/3/?limit=25#7e51https://sourceforge.net/p/j-spider/feature-requests/4/OnDiskStorage implementationEJPThu, 15 Jul 2021 02:06:17 -0000https://sourceforge.net/p/j-spider/feature-requests/4/https://sourceforge.net/p/j-spider/feature-requests/7/Add basic http auth (with patch)EJPThu, 15 Jul 2021 02:05:51 -0000https://sourceforge.net/p/j-spider/feature-requests/7/https://sourceforge.net/p/j-spider/feature-requests/4/OnDiskStorage implementationEJPThu, 15 Jul 2021 02:05:21 -0000https://sourceforge.net/p/j-spider/feature-requests/4/https://sourceforge.net/p/j-spider/feature-requests/7/Add basic http auth (with patch)EJPThu, 15 Jul 2021 02:04:51 -0000https://sourceforge.net/p/j-spider/feature-requests/7/https://sourceforge.net/p/j-spider/feature-requests/3/Make Caching site specific propertyEJPThu, 15 Jul 2021 02:04:23 -0000https://sourceforge.net/p/j-spider/feature-requests/3/https://sourceforge.net/p/j-spider/feature-requests/3/?limit=25#0a73This patch also requires adding the following to SpiderContextImpl.registerNewSite(), after all the other 'sitei' configurations: sitei.setCacheControl(siteProps.getString(ConfigConstants.SITE_CACHE_CONTROL, Constants.CACHE_CONTROL)); sitei.setUseCache(siteProps.getBoolean(ConfigConstants.SITE_CACHE_USE, false));EJPThu, 15 Jul 2021 02:04:23 -0000https://sourceforge.net/p/j-spider/feature-requests/3/?limit=25#0a73https://sourceforge.net/p/j-spider/feature-requests/2/Added functionality to StorageEJPThu, 15 Jul 2021 00:50:08 -0000https://sourceforge.net/p/j-spider/feature-requests/2/https://sourceforge.net/p/j-spider/feature-requests/4/OnDiskStorage implementationEJPThu, 15 Jul 2021 00:49:35 -0000https://sourceforge.net/p/j-spider/feature-requests/4/https://sourceforge.net/p/j-spider/feature-requests/4/?limit=25#327eIncorporated in upcoming 1.0 release.EJPThu, 15 Jul 2021 00:49:35 -0000https://sourceforge.net/p/j-spider/feature-requests/4/?limit=25#327ehttps://sourceforge.net/p/j-spider/feature-requests/7/Add basic http auth (with patch)EJPThu, 15 Jul 2021 00:49:02 -0000https://sourceforge.net/p/j-spider/feature-requests/7/https://sourceforge.net/p/j-spider/feature-requests/7/?limit=25#85bdIncorporated in upcoming 1.0 release.EJPThu, 15 Jul 2021 00:49:02 -0000https://sourceforge.net/p/j-spider/feature-requests/7/?limit=25#85bdhttps://sourceforge.net/p/j-spider/support-requests/1/new to search engineEJPThu, 15 Jul 2021 00:48:21 -0000https://sourceforge.net/p/j-spider/support-requests/1/https://sourceforge.net/p/j-spider/support-requests/1/?limit=25#4416Certainly.EJPThu, 15 Jul 2021 00:48:04 -0000https://sourceforge.net/p/j-spider/support-requests/1/?limit=25#4416https://sourceforge.net/p/j-spider/patches/1/fixes problem with redirects not specifying full urlEJPThu, 15 Jul 2021 00:44:45 -0000https://sourceforge.net/p/j-spider/patches/1/https://sourceforge.net/p/j-spider/bugs/20/Java 1.5.0 API Changes Thread.getState()EJPThu, 15 Jul 2021 00:38:11 -0000https://sourceforge.net/p/j-spider/bugs/20/https://sourceforge.net/p/j-spider/bugs/23/WorkerThread int getState method clashes with Java 1.5EJPThu, 15 Jul 2021 00:37:32 -0000https://sourceforge.net/p/j-spider/bugs/23/https://sourceforge.net/p/j-spider/bugs/25/Jspider crash on Web siteEJPThu, 15 Jul 2021 00:35:59 -0000https://sourceforge.net/p/j-spider/bugs/25/https://sourceforge.net/p/j-spider/bugs/25/?limit=25#3c3dThe StringIndexOutOfBoundsException is a duplicate of #5. The HTTP 500 status isn't a problem with JSpider. The notfound.htm error should have been fixed.EJPThu, 15 Jul 2021 00:35:59 -0000https://sourceforge.net/p/j-spider/bugs/25/?limit=25#3c3dhttps://sourceforge.net/p/j-spider/bugs/5/PANIC! Task net.javacoding.jspider.core.task.work.FetchRobotEJPThu, 15 Jul 2021 00:32:31 -0000https://sourceforge.net/p/j-spider/bugs/5/https://sourceforge.net/p/j-spider/bugs/5/?limit=25#296bFixed in upcoming 1.0 release.EJPThu, 15 Jul 2021 00:32:31 -0000https://sourceforge.net/p/j-spider/bugs/5/?limit=25#296bhttps://sourceforge.net/p/j-spider/bugs/8/No activity besides start page when robotstxt.fetch is falseEJPThu, 15 Jul 2021 00:24:35 -0000https://sourceforge.net/p/j-spider/bugs/8/https://sourceforge.net/p/j-spider/bugs/7/TextHtmlMimeTypeOnlyRule: Exception not caughtEJPThu, 15 Jul 2021 00:19:12 -0000https://sourceforge.net/p/j-spider/bugs/7/https://sourceforge.net/p/j-spider/bugs/7/?limit=25#cc07The only exception that can be thrown is InvalidStateForActionException, which indicates a coding bug. Unclear why this should be fixed.EJPThu, 15 Jul 2021 00:19:12 -0000https://sourceforge.net/p/j-spider/bugs/7/?limit=25#cc07https://sourceforge.net/p/j-spider/bugs/6/?limit=25#63c3Fixed in upcoming 1.0 release. Plugins can now have any of four constructors: () (PropertySet config) (String name) (String name, PropertySet config)EJPThu, 15 Jul 2021 00:13:07 -0000https://sourceforge.net/p/j-spider/bugs/6/?limit=25#63c3https://sourceforge.net/p/j-spider/bugs/6/DiskWriterPlugin constructor missing parameterEJPThu, 15 Jul 2021 00:09:01 -0000https://sourceforge.net/p/j-spider/bugs/6/https://sourceforge.net/p/j-spider/bugs/6/?limit=25#63c3Fixed in upcoming 1.0 release. Plugins can now have any of three constructors: () (PropertySet config) (String name, PropertySet config)EJPThu, 15 Jul 2021 00:09:01 -0000https://sourceforge.net/p/j-spider/bugs/6/?limit=25#63c3https://sourceforge.net/p/j-spider/bugs/9/Port is not included in the DiskWriterPlugin folder.EJPWed, 14 Jul 2021 23:59:16 -0000https://sourceforge.net/p/j-spider/bugs/9/https://sourceforge.net/p/j-spider/bugs/9/?limit=25#ea5cAfter consideration it seems to me that the present behaviour is correct. A site is identified by a hostname. A different protocol (http/https) or port doesn't make it a different site.EJPWed, 14 Jul 2021 23:59:16 -0000https://sourceforge.net/p/j-spider/bugs/9/?limit=25#ea5chttps://sourceforge.net/p/j-spider/bugs/11/Two sites on same physical machine considered equalEJPWed, 14 Jul 2021 23:56:53 -0000https://sourceforge.net/p/j-spider/bugs/11/https://sourceforge.net/p/j-spider/bugs/11/?limit=25#acc6Fixed in upcoming 1.0 release. SiteDAOImpl now keys from the hostname, not the URL, which solves other problems as well, e.g. different protocols or ports.EJPWed, 14 Jul 2021 23:56:53 -0000https://sourceforge.net/p/j-spider/bugs/11/?limit=25#acc6https://sourceforge.net/p/j-spider/bugs/12/Improper resolving of relative URLsEJPWed, 14 Jul 2021 23:40:00 -0000https://sourceforge.net/p/j-spider/bugs/12/https://sourceforge.net/p/j-spider/bugs/12/?limit=25#1772Fixed in upcoming 1.0 release.EJPWed, 14 Jul 2021 23:40:00 -0000https://sourceforge.net/p/j-spider/bugs/12/?limit=25#1772https://sourceforge.net/p/j-spider/bugs/13/I solve a spider exit jdbc bugEJPWed, 14 Jul 2021 23:33:12 -0000https://sourceforge.net/p/j-spider/bugs/13/https://sourceforge.net/p/j-spider/bugs/13/?limit=25#d8cbFixed in both setError() methods in upcoming 1.0 release.EJPWed, 14 Jul 2021 23:33:12 -0000https://sourceforge.net/p/j-spider/bugs/13/?limit=25#d8cbhttps://sourceforge.net/p/j-spider/bugs/14/Spider follows commented out linksEJPWed, 14 Jul 2021 23:25:56 -0000https://sourceforge.net/p/j-spider/bugs/14/https://sourceforge.net/p/j-spider/bugs/14/?limit=25#ec10Fixed in upcoming 1.0 release. A proper HTML parser is now used and links are identifed via XPath expressions. Comments are therefore ignored, as are element/attribute pairs that can't be links, even if they are.EJPWed, 14 Jul 2021 23:25:56 -0000https://sourceforge.net/p/j-spider/bugs/14/?limit=25#ec10https://sourceforge.net/p/j-spider/bugs/15/Query part is trimmed from URLsEJPWed, 14 Jul 2021 23:24:14 -0000https://sourceforge.net/p/j-spider/bugs/15/https://sourceforge.net/p/j-spider/bugs/15/?limit=25#8e1dQueyr removal has been made optional in the upcoming 1.0 release.EJPWed, 14 Jul 2021 23:24:14 -0000https://sourceforge.net/p/j-spider/bugs/15/?limit=25#8e1dhttps://sourceforge.net/p/j-spider/bugs/26/CookieDAOImpl uses incorrect SQLEJPWed, 14 Jul 2021 23:23:07 -0000https://sourceforge.net/p/j-spider/bugs/26/https://sourceforge.net/p/j-spider/bugs/16/Apparent URLs in HTML PRE elements are checkedEJPWed, 14 Jul 2021 23:22:22 -0000https://sourceforge.net/p/j-spider/bugs/16/https://sourceforge.net/p/j-spider/bugs/18/Plugin compatibility with libgcjEJPWed, 14 Jul 2021 23:21:07 -0000https://sourceforge.net/p/j-spider/bugs/18/https://sourceforge.net/p/j-spider/bugs/18/?limit=25#81b0The GNU CLASSPATH project to which libgcj belongs is defunct. It never really progressed beyond Java 1.2: it hasn't been updated since 2012; and the companion GCJ Java compiler project was terminated some years ago. Closing as out of date.EJPWed, 14 Jul 2021 23:20:47 -0000https://sourceforge.net/p/j-spider/bugs/18/?limit=25#81b0https://sourceforge.net/p/j-spider/bugs/18/?limit=25#81b0The GNIU CLASSPATH project is defunct. It never really progressed beyond Java 1.2: it hasn't been updated since 2012; and the companion GCJ Java compiler project was terminated some years ago. Closing as out of date.EJPWed, 14 Jul 2021 23:20:18 -0000https://sourceforge.net/p/j-spider/bugs/18/?limit=25#81b0https://sourceforge.net/p/j-spider/bugs/26/CookieDAOImpl uses incorrect SQLEJPWed, 14 Jul 2021 23:16:18 -0000https://sourceforge.net/p/j-spider/bugs/26/https://sourceforge.net/p/j-spider/bugs/26/?limit=25#7f9eFixed in upcoming 1.0 release.EJPWed, 14 Jul 2021 23:14:45 -0000https://sourceforge.net/p/j-spider/bugs/26/?limit=25#7f9ehttps://sourceforge.net/p/j-spider/discussion/222309/thread/c7a4d1ce/?limit=25#bcecYou can get it by listening to the SpideringStartedEvent event, i.e. by providing a visit(SpideringStartedEvent event) method.EJPWed, 14 Jul 2021 10:13:51 -0000https://sourceforge.net/p/j-spider/discussion/222309/thread/c7a4d1ce/?limit=25#bcechttps://sourceforge.net/p/j-spider/discussion/222310/thread/1b9e065b/?limit=25#c55bMySQL Blobs have 2^16-1 bytes. Change the column to a MEDIUMBLOB (2^24-1 bytes).EJPSat, 03 Jul 2021 07:37:31 -0000https://sourceforge.net/p/j-spider/discussion/222310/thread/1b9e065b/?limit=25#c55bhttps://sourceforge.net/p/j-spider/bugs/9/?limit=25#0d17It could be argued that the current behaviour is correct, given that say you don't want to treat http://localhost:80 and https://localhost:443 as different sites. Maybe it should distinguish different ports within the same protocol. I will ponder on this for the upcoming release.EJPSat, 03 Jul 2021 07:34:45 -0000https://sourceforge.net/p/j-spider/bugs/9/?limit=25#0d17https://sourceforge.net/p/j-spider/bugs/9/?limit=25#0d17It could be argued that this is correct, given that say you don't want to treat http://localhost:80 and https://localhost:443 as different sites. Maybe it should distinguish different ports within the same protocol. I will ponder on this for the upcoming release.EJPSat, 03 Jul 2021 07:34:28 -0000https://sourceforge.net/p/j-spider/bugs/9/?limit=25#0d17