Commit Graph

99 Commits (ead8eb126dd073f08a09461fb102c02d788fb3dc)

Author SHA1 Message Date
Yariv Menachem ead8eb126d fixed datetime import, new function to create dicts 2024-12-18 14:30:21 +02:00
Yariv Menachem 58f0793181 updated the flow like the test, Next: map to JobPost or use own classes 2024-12-17 19:55:34 +02:00
Yariv Menachem c47c1a7e77 filter by choice and hours works 2024-12-17 19:53:35 +02:00
Yariv Menachem 7971d0fab7 created new component to able test it properly 2024-12-17 19:00:47 +02:00
Yariv Menachem 7926356233 filter by hours old works! next is by filed column 2024-12-16 20:49:04 +02:00
Yariv Menachem bbe3d6df35 added json file to test the mapper, from json response to classes 2024-12-16 20:32:07 +02:00
Yariv Menachem b4454bfc65 add new request called part for smaller response 2024-12-16 15:48:59 +02:00
Yariv Menachem ce7bddf5c3 created new class to hold all data for the big request NEXT: create another based on this to get smaller response 2024-12-15 21:42:53 +02:00
Yariv Menachem c40c4745d7 delted temp scraper 2024-12-15 20:22:04 +02:00
Yariv Menachem a51876e730 fixed sending request to endpoint , the response is 200 2024-12-15 20:21:46 +02:00
Yariv Menachem f02e3f7a73 small changes to help testing 2024-12-15 18:40:32 +02:00
Yariv Menachem 00f13bdf1a current plan to get the response from goozali 2024-12-12 17:34:27 +02:00
Yariv Menachem 3dc15195d5 init commit
models ready, logic file for goozali based on the linkdin scraper
2024-12-12 17:22:58 +02:00
Yariv Menachem f0ea89b357 added support for indeed with ,multi locations, fixed parsing class to mongo 2024-12-12 13:37:39 +02:00
Yariv Menachem cb625f325f updated linkdin scrapper to support multi locations and each max retry it will continue to the next location 2024-12-12 12:05:38 +02:00
Yariv Menachem f4ebcc2d51 file structure fixed, exported telegram bot and jon collection to another class 2024-12-11 16:26:23 +02:00
Yariv Menachem b147ac7f85 added mongo to save new jobs, new column to jobPost beacause mongo doesnt support date, 2024-12-10 17:54:04 +02:00
Yariv Menachem d388211a92 added options to add more cities 2024-12-10 15:34:43 +02:00
Jason Geffner 4e7ac9a583
Fix Google job search (#223)
The previous regex did not capture all expected matches in the returned content
2024-12-04 16:45:59 -06:00
Cullen Watson 338d854b96
fix(google): search (#216) 2024-10-25 14:54:14 -05:00
Cullen Watson 10a3592a0f docs:file 2024-10-24 15:26:49 -05:00
Cullen Watson b7905cc756 docs:file 2024-10-24 15:24:18 -05:00
Cullen Watson f6248c8386
enh: google jobs (#214) 2024-10-24 15:19:40 -05:00
Cullen Watson f395597fdd fix(indeed): offset 2024-10-22 19:25:07 -05:00
Cullen Watson 9f4083380d
indeed:remove tpe (#210) 2024-10-19 18:01:59 -05:00
Marcel Gozalbo Baró 6bc191d5c7
FEATURE: Add the "ca_cert" setting for providing a Certification Authority certificate in order to use proxies requiring it. (#204) 2024-10-08 17:46:46 -05:00
Cullen Watson f7b29d43a2
fix(indeed):sort relevance not date (#197) 2024-09-18 18:42:25 -05:00
Cullen Watson 6f1490458c
fix key error (#186) 2024-08-14 02:54:40 -05:00
Cullen Watson 6bb7d81ba8
change linkedin ep (#185) 2024-08-14 02:39:43 -05:00
Cullen Watson 0e046432d1
fix:variable bug (#181) 2024-08-05 12:47:55 -05:00
Lluís Salord Quetglas 2a0cba8c7e
FEAT: Optional convertion to annual and know salary source (#170) 2024-07-17 21:05:33 -05:00
Cullen Watson 88c95c4ad5
enh: estimated salary (#169) 2024-07-16 19:20:34 -05:00
Cullen Watson 6330c14879 minor fix 2024-07-15 21:19:01 -05:00
Ali Bakhshi Ilani 48631ea271
Add company industry and job level to linkedin scraper (#166) 2024-07-15 21:07:39 -05:00
Cullen Watson edffe18e65
enh: listing source (#168) 2024-07-15 20:30:04 -05:00
Lluís Salord Quetglas 0988230a24
FEAT: Add Glassdoor logo data if available (#167) 2024-07-15 20:25:18 -05:00
Cullen Watson d000a81eb3
Salary parse (#163) 2024-06-09 17:45:38 -05:00
Cullen Watson ccb0c17660
enh: ziprecruiter full description (#162) 2024-06-09 16:21:01 -05:00
Cullen Watson 89a3ee231c
enh(li): job function (#160) 2024-05-28 16:01:29 -05:00
Cullen 6439f71433 chore: version 2024-05-28 15:39:24 -05:00
adamagassi 7f6271b2e0
LinkedIn scraper fixes: (#159)
Correct initial page offset calculation
Separate page variable from request counter
Fix job offset starting value
Increment offset by number of jobs returned instead of expected value
2024-05-28 15:38:13 -05:00
Cullen Watson 5cb7ffe5fd
enh: proxies (#157)
* enh: proxies

* enh: proxies
2024-05-25 14:04:09 -05:00
fasih hussain 08d63a87a2
chore: id added for JobPost schema (#152) 2024-05-20 11:45:52 -05:00
Cullen 1ffdb1756f fix: dup line 2024-04-30 12:11:48 -05:00
Lluís Salord Quetglas dcd7144318
FIX: Allow Indeed search term with complex syntax (#139) 2024-04-30 12:05:43 -05:00
Cullen Watson bf73c061bd
enh: linkedin company logo (#141) 2024-04-30 12:03:10 -05:00
Lluís Salord Quetglas 8dd08ed9fd
FEAT: Allow LinkedIn scraper to get external job apply url (#140) 2024-04-30 11:36:01 -05:00
Cullen 3e93454738 fix(indeed): readd param 2024-03-11 21:23:20 -05:00
VitaminB16 4b7bdb9313
feat: Adjust log verbosity via verbose arg (#128) 2024-03-11 14:38:44 -05:00
Cullen Watson ada38532c3 fix: indeed empty location term 2024-03-11 09:42:43 -05:00