Commit Graph

113 Commits (1f717bd9e30119af886d6362efe718829e853a7f)

Author SHA1 Message Date
Zachary Hampton 088088ae51 - last x days param 2023-10-03 15:05:17 -07:00
Zachary Hampton 40bbf76db1 - realtor radius 2023-10-02 13:58:47 -07:00
Zachary Hampton 1f1ca8068f - realtor.com default 2023-10-02 10:28:13 -07:00
james 8962d619e1 Match observed behaivor in FireFox of not sending ua-ch headers in request to prevent recent 403 2023-10-01 11:31:51 +08:00
Zachary Hampton 3b7c17b7b5 - zillow proxy support 2023-09-28 18:40:16 -07:00
Zachary Hampton 896f862137 - zillow flow update 2023-09-28 18:25:47 -07:00
Zachary Hampton 2abbb913a8 - convert posted_time to datetime
- zillow location bug fix
2023-09-28 18:07:42 -07:00
Cullen Watson 73b6d5b33f [fix] zilow tls client 2023-09-28 19:34:01 -05:00
Zachary Hampton 01c53f9399 - redfin bug fix
- add recent features for issues
2023-09-28 15:19:43 -07:00
Zachary Hampton 9e262bf214 Merge remote-tracking branch 'origin/master' 2023-09-23 10:55:29 -07:00
Zachary Hampton 82f78fb578 - zillow bug fix 2023-09-23 10:55:14 -07:00
Cullen Watson 2fc40e0dad fix: cookie 2023-09-22 09:47:37 -05:00
Zachary Hampton 254f3a68a1 - redfin bug fix 2023-09-21 18:54:03 -07:00
Zachary Hampton 05713c76b0 - redfin bug fix
- .get
2023-09-21 11:27:12 -07:00
Cullen Watson 9120cc9bfe fix: remove line 2023-09-21 13:10:14 -05:00
Cullen Watson c25961eded fix: KeyEror : [minBaths] 2023-09-21 13:06:06 -05:00
Cullen Watson 48c2338276 fix: keyerror 2023-09-21 11:18:37 -05:00
Cullen Watson 644f16b25b feat: keep duplicates flag 2023-09-20 20:24:18 -05:00
Cullen Watson f6054e8746 fix: simplify fields 2023-09-19 21:13:20 -05:00
Cullen Watson 043f091158 fix: keyerror on address 2023-09-19 16:43:17 -05:00
Cullen Watson 0dae14ccfc fix: proxy add to session correctly 2023-09-19 16:05:14 -05:00
Cullen Watson cdf41fe9f2 fix: remove self.proxy 2023-09-19 15:49:50 -05:00
Cullen Watson 1f0feb836d refactor: move proxy to session 2023-09-19 15:48:46 -05:00
Cullen Watson fd9cdea499 feat: proxy support 2023-09-19 15:43:24 -05:00
Cullen Watson 49d27943c4 add cli 2023-09-19 15:01:39 -05:00
Zachary Hampton 20ce44fb3a - redfin limiting bug fix 2023-09-19 10:37:10 -07:00
Cullen Watson dba1c03081 feat(redfin): add sold listing_type 2023-09-19 12:27:13 -05:00
Cullen Watson 1fc2d8c549 feat(redfin): rental support 2023-09-19 11:58:20 -05:00
Zachary Hampton 78b56c2cac - zillow location validation 2023-09-19 09:25:08 -07:00
Cullen Watson 62e3321277 fix(zillow): test case 2023-09-18 22:59:49 -05:00
Zachary Hampton 3ec47c5b6a - invalid test cases
- redfin and realtor bug fixes
- dupe check bug fix
2023-09-18 20:28:03 -07:00
Cullen Watson 2eec389838 docs: add logo 2023-09-18 21:02:12 -05:00
Cullen Watson cc76e067b2 fix: lat/long KeyError 2023-09-18 20:01:55 -05:00
Cullen Watson 82092faa28 docs: readme 2023-09-18 19:35:38 -05:00
Zachary Hampton 8f90a80b0a - lat lon on realtor & redfin 2023-09-18 16:22:47 -07:00
Cullen Watson 086bcfd224 fix: check for suite 2023-09-18 17:57:15 -05:00
Cullen Watson 4726764482 refactor: merge master 2023-09-18 17:46:05 -05:00
Cullen Watson ca260fd2b4 fix: filter dup on street, unit, city 2023-09-18 17:42:16 -05:00
Zachary Hampton 94e5b090da - refactor 2023-09-18 15:22:43 -07:00
Cullen Watson 8e140a0e45 chore: format 2023-09-18 17:04:54 -05:00
Cullen Watson 588689c230 fix: normalize unit num 2023-09-18 17:04:34 -05:00
Cullen Watson c7a4bfd5e4 feat: run all 3 sites with one scrape_property() call 2023-09-18 16:18:22 -05:00
Cullen Watson 869d7e7c51 refator(realtor): fit to updated models 2023-09-18 15:43:44 -05:00
Cullen Watson ffd3ce6aed reactor(redfin) 2023-09-18 14:36:18 -05:00
Cullen Watson 471e53118e refactor(redfin): fit to use updated models 2023-09-18 14:07:37 -05:00
Cullen Watson dc8c15959f fix: use zillow backend ep 2023-09-18 13:38:17 -05:00
Zachary Hampton 6b02394e95 - scrape_property docstring 2023-09-18 08:37:07 -07:00
Zachary Hampton ba249ca20d - redfin buildings support 2023-09-18 08:26:35 -07:00
Zachary Hampton ba9fe806a7 - finished realtor 2023-09-18 08:16:59 -07:00
Cullen Watson 905cfcae2c refactor: scrape_property() 2023-09-17 18:52:34 -05:00
Cullen Watson 3697b7cf2d feat: add pandas 2023-09-17 18:30:37 -05:00
Cullen Watson b76c659f94 refactor: remove cls method 2023-09-17 16:14:09 -05:00
Cullen Watson 2f5ea1ca88 feat(scrapers): add zillow 2023-09-17 15:06:31 -05:00
Zachary Hampton 2f3b012747 - single address support 2023-09-16 14:34:10 -07:00
Zachary Hampton 5ea0fa0bdb - redfin city support
- test case updates
- types addition
- docs grammar
2023-09-16 13:39:03 -07:00
Zachary Hampton a772fe45aa - rename to property 2023-09-16 10:11:39 -07:00
Zachary Hampton 0946abd35a - realtor init 2023-09-15 20:58:54 -07:00
Zachary Hampton 8107103383 - redfin finished 2023-09-15 16:03:17 -07:00
Zachary Hampton 469b703288 - redfin init 2023-09-15 15:42:47 -07:00
Zachary Hampton a79c4c6872 - housekeeping 2023-09-15 15:21:29 -07:00
Zachary Hampton ed7e76e4b0 - base 2023-09-15 15:17:37 -07:00
Zachary Hampton 6e3ab86885 - scrapers & pypi init 2023-09-15 13:06:14 -07:00
Zachary Hampton 0777157eea - init 2023-09-15 12:58:52 -07:00