Commit Graph

116 Commits (b4454bfc653c1f232abe0a2fb6be1ebbc7615f3b)

Author SHA1 Message Date
Yariv Menachem b4454bfc65 add new request called part for smaller response 2024-12-16 15:48:59 +02:00
Yariv Menachem ce7bddf5c3 created new class to hold all data for the big request NEXT: create another based on this to get smaller response 2024-12-15 21:42:53 +02:00
Yariv Menachem c40c4745d7 delted temp scraper 2024-12-15 20:22:04 +02:00
Yariv Menachem a51876e730 fixed sending request to endpoint , the response is 200 2024-12-15 20:21:46 +02:00
Yariv Menachem f02e3f7a73 small changes to help testing 2024-12-15 18:40:32 +02:00
Yariv Menachem 00f13bdf1a current plan to get the response from goozali 2024-12-12 17:34:27 +02:00
Yariv Menachem 3dc15195d5 init commit
models ready, logic file for goozali based on the linkdin scraper
2024-12-12 17:22:58 +02:00
Yariv Menachem f0ea89b357 added support for indeed with ,multi locations, fixed parsing class to mongo 2024-12-12 13:37:39 +02:00
Yariv Menachem cb625f325f updated linkdin scrapper to support multi locations and each max retry it will continue to the next location 2024-12-12 12:05:38 +02:00
Yariv Menachem f1c39e47bd fixed location string to be more readable and adde telegram test 2024-12-11 17:57:00 +02:00
Yariv Menachem d6655676f3 added defualt value for creating athe repo 2024-12-11 17:40:40 +02:00
Yariv Menachem bfc83bdc03 added model dump method to fix insert problem to mongo 2024-12-11 17:22:53 +02:00
Yariv Menachem 175acfb918 fixed runing tests 2024-12-11 16:42:38 +02:00
Yariv Menachem bf974467ab fixed runing main 2024-12-11 16:38:45 +02:00
Yariv Menachem f4ebcc2d51 file structure fixed, exported telegram bot and jon collection to another class 2024-12-11 16:26:23 +02:00
Yariv Menachem c6a7729481 removed test line code 2024-12-11 11:35:36 +02:00
Yariv Menachem 968da48728 added env file to store the keys 2024-12-11 11:32:58 +02:00
Yariv Menachem cc782ddfc1 aligned and added the telegram and chat id 2024-12-10 19:29:34 +02:00
Yariv Menachem b147ac7f85 added mongo to save new jobs, new column to jobPost beacause mongo doesnt support date, 2024-12-10 17:54:04 +02:00
Yariv Menachem d388211a92 added options to add more cities 2024-12-10 15:34:43 +02:00
Yariv Menachem 7c002ae76e fixed structure 2024-12-09 16:13:07 +02:00
Yariv Menachem 53a840e53e created main
fixed israel search on glasdoor and added to gitignore the csv and debug json
2024-12-08 17:30:06 +02:00
Jason Geffner 4e7ac9a583
Fix Google job search (#223)
The previous regex did not capture all expected matches in the returned content
2024-12-04 16:45:59 -06:00
Cullen Watson 338d854b96
fix(google): search (#216) 2024-10-25 14:54:14 -05:00
Cullen Watson 10a3592a0f docs:file 2024-10-24 15:26:49 -05:00
Cullen Watson b7905cc756 docs:file 2024-10-24 15:24:18 -05:00
Cullen Watson f6248c8386
enh: google jobs (#214) 2024-10-24 15:19:40 -05:00
Cullen Watson f395597fdd fix(indeed): offset 2024-10-22 19:25:07 -05:00
Cullen Watson 9f4083380d
indeed:remove tpe (#210) 2024-10-19 18:01:59 -05:00
Olzhas Arystanov 9207ab56f6
fix: extract tests out of src (#209) 2024-10-19 16:56:38 -05:00
Marcel Gozalbo Baró 6bc191d5c7
FEATURE: Add the "ca_cert" setting for providing a Certification Authority certificate in order to use proxies requiring it. (#204) 2024-10-08 17:46:46 -05:00
Cullen Watson 0cc34287f7 fix:turkey 2024-10-02 01:31:00 -05:00
Anton Pikhteryev 923979093b
Add Malta for linkedin country support (#198) 2024-09-19 20:41:22 -05:00
Cullen Watson f7b29d43a2
fix(indeed):sort relevance not date (#197) 2024-09-18 18:42:25 -05:00
Cullen Watson 6f1490458c
fix key error (#186) 2024-08-14 02:54:40 -05:00
Cullen Watson 6bb7d81ba8
change linkedin ep (#185) 2024-08-14 02:39:43 -05:00
Cullen Watson 0e046432d1
fix:variable bug (#181) 2024-08-05 12:47:55 -05:00
Cullen Watson 209e0e65b6
fix:malaysia indeed (#180) 2024-08-03 22:48:53 -05:00
Cullen Watson 8570c0651e
fix:key error (#176) 2024-07-21 13:05:18 -05:00
Cullen Watson 8678b0bbe4
enh: test on pr (#174) 2024-07-19 14:25:25 -05:00
Cullen Watson 60d4d911c9
lock file (#173) 2024-07-17 21:21:22 -05:00
Lluís Salord Quetglas 2a0cba8c7e
FEAT: Optional convertion to annual and know salary source (#170) 2024-07-17 21:05:33 -05:00
Cullen Watson 88c95c4ad5
enh: estimated salary (#169) 2024-07-16 19:20:34 -05:00
Cullen Watson 6330c14879 minor fix 2024-07-15 21:19:01 -05:00
Ali Bakhshi Ilani 48631ea271
Add company industry and job level to linkedin scraper (#166) 2024-07-15 21:07:39 -05:00
Cullen Watson edffe18e65
enh: listing source (#168) 2024-07-15 20:30:04 -05:00
Lluís Salord Quetglas 0988230a24
FEAT: Add Glassdoor logo data if available (#167) 2024-07-15 20:25:18 -05:00
Cullen Watson d000a81eb3
Salary parse (#163) 2024-06-09 17:45:38 -05:00
Cullen Watson ccb0c17660
enh: ziprecruiter full description (#162) 2024-06-09 16:21:01 -05:00
Cullen Watson 89a3ee231c
enh(li): job function (#160) 2024-05-28 16:01:29 -05:00